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Reliability  Improvement  Warranties  illustrate  a new 
contractual  technique  for  improving  reliability  by  providing 
a strong  monetary  incentive  to  the  contractor.  This  incen- 
tive, however,  also  places  additional  monetary  risk  on  the 
contractor.  Industry  has  expressed  mounting  concerns  over 
this  risk.  This  thesis  contains  an  examination  of  the 
relationship  between  government  benefits  and  contractor 
risk.  Existing  and  proposed  RIW  contracts  are  evaluated 
in  regard  to  the  type  of  equipment  under  warranty,  the  use 
of  exclusions,  penalties  for  non-compliance,  and  RIW  price. 
The  results  of  the  analysis  illustrate  how  RIW  is  being 
used  by  the  government. 
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INTRODUCTION 


I . 

The  need  to  improve  combat  effectiveness  and  reduce 
skyrocketing  equipment  support  costs  has  been  recognized 
as  a major  problem  by  the  Department  of  Defense.  The 
problem  exists  because  performances  and  acquisition  costs 
have  become  the  driving  factors  behind  the  procurement  of 
new  weapon  systems.  Reliability  requirements  have  not 
been  integrated  with  the  design  effort  and  usually  have 
been  designated  for  demonstration  only  at  the  conclusion 
of  full  scale  development.  The  demonstration  was  normally 
conducted  in  a laboratory  environment  that  had  little 
resemblance  to  the  actual  environment  the  equipment  was 
faced  with  in  the  field.  Contractors  viewed  this  demonstra- 
tion as  the  only  reliability  hurdle  their  equipment  had  to 
pass  and  were  strongly  motivated  to  design  to  the  benign 
test  environment.  Because  the  government  was  intimately 
involved  with  the  contractor  during  the  design  effort  and 
frequently  initiated  design  changes,  responsibility  for 
reliability  became  diffused.  Original  reliability  standards 
were  not  enforced  and  sometimes  were  lowered  when  it  became 
apparent  they  could  not  be  met.  Contractors,  who  have  been 
capable  of  designing  and  producing  reliable  hardware,  did 
not  do  so  because  their  rewards  were  realized  from  producing 
a high  performance  system  for  the  least  possible  cost  and 
not  from  the  production  of  reliable  equipment. 
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A.  OBJECTIVE  OF  RIW 


In  a joint  memorandum  dated  14  August  1974,  the  Director, 

Defense  Research  and  Engineering  and  the  Assistant  Secretary 

of  Defense  (I&L)  stated  that  the  objective  of  RIW  is: 

"...  to  motivate  and  provide  an  incentive 
to  contractors  to  design  and  produce 
equipment  which  will  have  low  failure 
rates  and  low  repair  costs  during  field/ 
operational  use.  This  technique  attempts, 
through  the  use  of  contractual  agreements 
(which  extend  for  several  years  after 
government  acceptance  of  the  equipment) 
to  provide  an  incentive  for  contractors 
to  improve  the  reliability  of  their 
equipment  and  to  reduce  repair  costs  in 
I order  to  maximize  their  profits.  Thus 

the  intent  of  the  RIW7  contracting  technique 
is  to  realize  improved  operational 
reliability  and  maintainability  of  DOD 
systems  and  equipments  for  each  additional 
dollar  that  the  contractor  earns.  For 
these  reasons,  a RIW  is  not  a maintenance 
contract  and  should  not  be  used  for  this 
purpose . " 

The  proper  application  of  PIW  should  therefore  result 
in  the  acquisition  of  equipment  that  has  been  designed  and 
produced  to  have  a low  initial  failure  rate  in  the  field. 

This  initial  failure  rate  will  be  lowered  even  further  during 
the  warranty  period  due  to  the  incentive  the  RIW  provides 
the  contractor.  The  maximum  benefits  from  RIW  are  therefore 
expected  to  be  realized  during  the  initial  years  of  an 
equipment  deployment.  At  the  end  of  the  warranty  period 
the  government  can  either  extend  the  warranty  or  assume  its 
own  organic  maintenance.  It  is  anticipated  that  at  the  end 
of  the  warranty  period  the  reliability  of  the  equipment  will 
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have  grown  to  a point  w here  the  number  and  costs  of  repairs 
are  much  lower  than  if  the  government  had  not  applied  the 
warranty  and  assumed  its  own  organic  maintenance  when  the 
equipment  was  initially  introduced. 

B.  PIW  DEFINITION 

A Reliability  Improvement  Warranty  (RIW)  is  a fixed 
price  commitment  that  obligates  the  contractor  to  repair 
or  replace,  within  a specified  time,  all  warranted  equipment 
that  fails  during  the  period  of  coverage.  "deally,  RIW 
motivates  the  contractor  to  increase  reliability  in  order 
to  decrease  his  repair  warranty  costs  and  maximize  his 
profits.  In  a pure  RIW  contract  the  contractor  is  not 
obligated  to  provide  equipment  that  demonstrates  a specified 
Mean  Time  Between  Failure  (MTBF) . Instead  the  price  of  a 
warranty  is  calculated  using  an  "expected"  MTBF.  If  the 
field  MTBF  falls  below  this  level  the  contractor  will  not 
realize  a profit  since  the  increased  number  of  failures 
increase  his  repair  costs.  An  increase  in  MTBF  above  the 
"expected"  level  will,  in  the  same  manner,  decrease  his 
repair  costs  and  increase  his  prefit.  The  contractor  is 
therefore  motivated  to  increase  the  MTBF  of  the  equipment 

as  much  as  possible  if  the  realized  savings  from  decreased  j 

repair  costs  are  greater  than  the  cost  of  improving  the 

MTBF . I 

A RIW  may  also  be  used  in  association  with  a MTBF 
guarantee  as  part  of  the  warranty  agreement.  This  arrangement 
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requires  the  contractor  to  guarantee  that  a stated  MTBF 
will  be  experienced  by  the  equipment  in  the  field.  Failure 
to  meet  this  guarantee  level  requires  the  contractor  to 
institute  corrective  action  and  provide  additional  spares 
to  the  government  until  the  MTBF  improves. 

In  any  case  the  RIW  provisions  should  be  established  as 
a separate  line  item  in  the  contract  so  that  the  cost  of  the 
warranty  can  be  evaluated.  In  the  case  of  RIW  with  a MTBF 
guarantee  the  additional  cost  of  the  MTBF  guarantee  option 
should  also  be  established  as  a separate  line  item  so  that 
the  additional  protection  of  the  guarantee  also  may  be 
evaluated  for  cost  effectiveness. 

Although  RIW  can  be  used  to  improve  the  reliability  of 
equipment  already  in  the  field  by  applying  the  warranty  to 
an  equipment  overhaul  contract,  the  major  benefits  arise 
from  using  the  concept  in  the  initial  production  contract 
for  new  equipment. 

C.  RIW  AND  THE  SYSTEM  LIFE  CYCLE 

Although  application  of  an  RIW  is  associated  with  a 
production  contract,  it  is  important  that  the  concept  be 
considered  early  in  an  equipment's  life  cycle  since  a 
decision  to  use  RIW  will  affect  the  configuration  and  design 
as  well  as  the  planning  needed  to  obtain  and  support  the 
warranted  item.  The  interface  of  warranty  activities  with 
the  acquisition  cycle  is  shown  in  Figure  1. 
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Figure  1.  RIW  and  the  System  Life  Cycle  for  New  Equipment 


During  the  conceptual  stage  studies  are  usually  made 
that  include  the  relationship  of  reliability,  maintainability 
and  expected  life  cycle  cost.  RIW  as  well  as  other  methods 
should  be  considered  as  a means  of  achieving  goals  and  con- 
trolling costs.  In  some  cases  a more  traditional  approach 
of  specifying  a design  MTBF  will  be  more  appropriate.  This 
is  especially  true  for  equipments  that  do  not  meet  RIW 
application  criteria  (Table  1) . Another  option  is  to  com- 
pare Target  Logistic  Support  cost  with  Measured  Logistic 
Support  Cost,  a method  that  will  be  discussed  in  the  F-16 
contract  between  the  U.S.  Air  Force  and  General  Dynamics. 

The  Development  Concept  Paper"''  (DCP)  should  include  instruc- 
tions or  requirements  for  the  use  of  such  control  techniques. 

During  the  Validation  Phase,  consideration  is  given  to 
required  reliability  levels  and  their  impact  on  system 
support.  Consideration  should  also  be  given  to  methods  that 
can  be  used  to  achieve  reliability  levels.  At  this  point, 
equipment  candidates  for  RIW  should  be  screened  to  determine 
it  application  criteria  are  met.  Assuming  the  results  of 
this  initial  screening  are  positive,  an  economic  analysis 
should  be  carried  out  on  each  candidate  to  determine  the 


^"The  DCP  is  a coordinated,  management  document  which 
serves  as  the  vehicle  for  the  Secretary  of  Defense's  decision 
on  major  development  programs;  the  record  of  primary  program 
information,  decision  rationale,  and  decision  review 
thresholds;  and  the  instrument  to  effect  implementation  of 
these  decisions. 


14 


TABLE  1 

RIW  APPLICATION  CRITERIA 

compiled  from  criteria  stated  by  OSD(I&L),  Army 
Material  Command,  and  Naval  Air  Systems  Command 

1.  Warranty  can  be  obtained  at  price  commensurate  with  the 
contemplated  value  of  the  warranty  work  to  be  accomplished. 

2.  Moderate  to  high  initial  support  costs  are  involved. 

3.  Unit  is  generally  self  contained,  immune  from  induced 
failures  from  outside  units,  and  has  readily  identifiable 
failure  characteristics. 

4.  Unit  is  readily  transportable  to  permit  return  to  vendo-  s 
plant  or  contractor  can  provide  field  service  for  it. 

5.  Expected  operating  time  and  use  environment  known. 

6.  Can  be  contracted  for  on  a fixed  price  basis. 

7.  Contract  can  be  structured  for  a warranty  period  of 
several  years  so  contractor  has  time  to  identify  and 
analyze  failures  to  permit  reliability  and  maintainability 
improvements . 

8.  Unit  has  potential  for  reliability  growth  and  reduction 
in  repair  costs. 

9.  Potential  contractors  indicate  cooperative  attitude 
toward  RIW  acceptance  and  evaluation  of  effectiveness. 

10.  Enough  units  are  to  be  procured  to  make  RIW  cost  effective. 

11.  Unit  is  configured  to  discourage  unauthorized  field 
repair,  preferably  sealed  and  capable  of  containing 
elapsed  time  indicator. 

12.  Reasonable  assurance  of  high  use  of  item. 

13.  Unit  permits  contractor  to  effect  no  cost  ECP ' s subsequent 
to  government  approval. 

14.  Failure  data  and  operational  use  data  can  be  furnished 
contractor  and  updated  periodically  through  life  of  warranty. 

15.  Field  reliability,  costs  to  support,  and  reliability 
growth  are  reasonably  predictable. 

16.  Terms  of  RIW  can  be  tailored  so  that  risks  and  rewards 
to  government  and  industry  are  acceptable. 

17.  Spare  part  requirements  are  difficult  to  predict. 

18.  Cost  of  the  RIW  can  be  separately  priced. 

19.  Multiple-year  procurement  (competitive  or  sole  source) 
is  feasible. 

20.  Unit  is  equipped  with  an  elapsed  time  indicator; 
otherwise,  the  warranty  must  be  based  on  calendar  time, 
or  some  other  means  of  determining  usage. 
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economic  feasibility  of  the  warranty  and  the  desired  warranty 
period.  Initial  warranty  provisions  should  then  be  deter- 
mined. In  order  to  communicate  to  the  contractor  the  inten- 
tion that  a warranty  provision  is  being  considered,  the 
Request  for  Proposal  ( RFP ) for  the  Full-Scale  Development 
Phase  should  contain  a sample  warranty  provision  intended 
for  use  in  the  production  contract.  The  RFP  should  also  ask 
respondents  to  discuss  their  understanding  of  the  warranty 
provision  and  how  they  would  operate  under  the  warranty 
program. 

During  the  Development  Phase,  initial  economic  feasi- 
bility studies  and  warranty  provisions  should  be  updated 
to  reflect  program  and  equipment  changes.  At  the  end  of 
this  phase  warranty  provisions  are  incorporated  into  the 
production  RFP.  The  warranty  proposals  provided  by  the 
responding  contractors  are  then  evaluated  and  a final  deci- 
sion made  regarding  the  intention  to  use  RIW.  If  the  deci- 
sion is  made  to  apply  RIW,  the  source  selection  activity, 
uses  the  contractor's  warranty  proposal  information  as  an 
integral  part  of  its  evaluation  criteria. 

During  the  Production  Phase  a plan  to  administer  the 
warranty  must  be  developed.  The  plan  should  include  pro- 
visions for: 

1.  How  the  flow  of  the  warranted  equipment  from  the 
service's  logistic  management  system  will  interface  with 


the  contractor. 


2.  User  indoctrination  for  processing  the  warrantied 
equipment . 

3.  Requirements  for  receiving  inspection,  and 
documentation  at  the  contractor  plant. 

4.  Requirements  for  the  contractors  and  government  data 
system. 

5.  Offices  responsible  for  the  contract  administration 
should  be  identified  and  be  supplied  proper  data  for 
administering  the  warranty. 

6.  Methods  for  expeditious  processing  of  Engineering 

2 

Change  Proposals  (ECP's)  must  be  established. 

7.  If  required,  the  contractor's  repair  and  storage 
facilities  should  be  reviewed. 

8.  Technical  data  review  to  insure  that  contractor 
has  placed  notice  of  the  warranty  and  warranty  procedures 
in  the  applicable  technical  publication. 

9.  Review  of  Warranty  Marking  and  Seals. 

During  the  Operational  Phase  the  warranty  should  be 
monitored  to  insure  that  no  problems  develop  in  the  overall 
logistic  flow  of  the  equipment.  If  problems  develop, 


2 

An  ECP  is  a proposal  to  make  an  alteration  in  the 
physical  or  functional  characteristics  of  an  item  delivered, 
to  be  delivered,  or  under  development , after  establishment 
of  such  characteristics. 
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adjustments  to  the  original  warranty  procedures  may  be 
required,  however,  if  there  is  a change  in  the  RIW  contract 
it  must  be  renegotiated  and  additional  cost  may  be  incurred. 
Before  the  end  of  the  warranty  period  an  evaluation  should 
be  conducted  to  determine  if  the  warranty  should  be  extended. 
The  original  terms  and  conditions  of  the  RIW  should  be 
reviewed  to  determine  if  they  are  still  applicable.  A new 
warranty  agreement  must  be  negotiated  with  the  contractor 
and  a decision  made  to  either  extend  the  warranty  or  convert 
to  organic  maintenance.  If  a decision  is  made  to  convert 
to  organic  maintenance  the  conversion  should  be  monitored 
to  insure  that  test  equipment,  technical  data/publications, 
spares,  training,  and  maintenance  facilities  are  provided 
to  the  government  within  the  terms  of  the  initial  agreement. 

A RIW  provision  for  an  equipment  overhaul  contract  must 
pass  through  most  of  the  same  procedures,  however,  since 
the  equipment  is  already  in  the  field  these  actions  are  taken 
during  the  operation  phase  (Figure  2)  and  do  not  have  an 
effect  on  equipment  design. 

D.  POTENTIAL  BENEFITS  FROM  RIW 

Potential  benefits  to  both  the  government  and  the  contrac- 
tor are  anticipated  from  the  use  of  RIW. 

1 . Benefits  to  the  Government. 

a.  Incentives  and  responsibility  for  field  reliability 
are  assigned  to  the  contractor. 
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b.  Greater  emphasis  placed  on  Life  Cycle  Cost.3 

c.  Contractor  is  responsible  for  keeping  all  units 
up  to  the  same  configuration. 

d.  There  is  an  increased  incentive  for  the  contrac- 
tor to  introduce  design/production  changes  that  will  increase 
the  MTBF  of  the  equipment  and  result  in  reliability  growth. 

e.  An  incentive  for  reduction  in  repair  costs  is 
provided,  since  any  reduction  in  labor  hours  or  material 
costs  used  in  repairing  the  equipment  will  increase  the 
contractor's  profits. 

f.  Minimal  initial  investment  for  support  equipment 
is  required  by  the  government,  since  the  contractor  is  to 
provide  repair  services  during  the  warranty  period. 

g.  RIW  usage  may  reduce  requirements  for  skilled 
military  maintenance  and  support  manpower. 

2 . Benefits  to  the  Contractor. 

a.  Increased  profit  potential  when  MTBF  is  improved 
above  pricing  base. 

b.  Multi-year  guaranteed  repair  business  during 
the  warranty  period. 

c.  The  contractor  becomes  more  familiar  with  the 
operational  reliability  and  maintainability  of  his  equipment, 
which  should  help  him  in  obtaining  follow-on  contracts. 

3 

The  total  cost  tc  the  government  for  the  development , 
acquisition,  operation  and  logistic  support  of  a system 
over  a defined  life  span. 
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E.  CONTRACTOR  RISK 

The  major  concern  about  the  use  of  RIW  has  been  the 
monetary  risk  to  which  a contractor  may  be  exposed.  The 
risk  is  caused  by  uncertainty  in  the  field  failure  rate  of 
the  warranted  equipment.  The  key  element  in  the  contrac- 
tor's pricing  of  a RIW  is  the  predicted  number  of  returned 
items  the  contractor  will  have  to  process  and  repair  during 
the  warranty  period.  If  the  contractor's  estimate  of  this 
rate  of  return  is  too  low  he  can  suffer  a decrease  in  profits 
or  even  a monetary  loss.  Conversely,  if  his  estimate  is  too 
high  and  he  prices  the  RIW  accordingly  he  stands  to  lose  the 
contract  to  a lower  bidder,  or  if  he  is  awarded  the  contract 
will  experience  excess  profits.  New  equipment,  'for  which  no 
field  failure  data  is  available,  is  the  riskiest  to  warrant, 
while  equipment  which  has  been  deployed  and  which  has  a 
known  field  failure  rate  provides  the  least  risk.  As  men- 
tioned previously,  however,  the  anticipated  RIW  benefits 
for  the  government  are  greater  for  new  equipment  than  for 
equipment  already  in  the  field.  The  balance  between  risk 
and  benefits  can  be  partially  maintained  by  the  price  of 

the  RIW  and  various  contract  clauses  or  exclusions  that  j 

attempt  to  lower  uncertainty. 


21 


II.  INTERRELATIONSHIPS  OR  RIW  WITH  FIELD  RELIABILITY, 
CONTRACTOR  RISK,  AND  OOVERNMENT  COST 

A.  RIW  AND  FIELD  RELIABILITY 

RIW  seeks  to  improve  combat  effectivenss  by  improving 
field  reliability.  One  of  the  problems  associated  with 
this  approach  is  defining  field  reliability  in  terms  that 
can  be  measured.  Historically,  reliability  values  have 
been  stated  in  terms  of  Mean  Time  Between  Failure  (MTBF) 
which  describes  the  expected  number  of  failures  due  to 
inherent  system  design.  The  design  specifications  for 
reliability  normally  include  specific  environmental  condi- 
tions such  as  temperature,  vibration  and  humidity.  Unfor- 
tunately, the  projected  reliability  performance  based  on 
these  specifications  has  been  much  higher,  often  by  a factor 
of  ten  or  more,  than  the  reliability  experienced  by  the 
equipment  in  the  field  (Figure  3).  The  reasons  for  this 
discrepancy  are  easy  to  identify  but  hard  to  correct.  A 
large  proportion  of  field  failures  are  due  to  causes  which 
are  hard  to  define  in  specifications  (Figure  4).  Even  if 
all  field  failure  causes  could  be  identified  and  included 
in  the  reliability  specifications,  a demonstration  test  to 
show  that  these  specifications  had  been  met  would  have  to 
be  a full  field  test  utilizing  operational  personnel  and 
conducted  in  an  operational  environment.  The  time  and  money 
necessary  to  conduct  this  type  of  testing  is  not  available. 
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Figure  3.  Selected  Equipment  Trend 
for  Contemporary  Weapon 
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"Evaluation  of  Environmental  Profiles  for  Reliability 
Demonstration,"  RADC-TR-75-242 , Rome  Air  Development  Center 
Griffiss  Air  Force  Base,  New  York,  September  1975. 
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Figure  4.  Avionics  Equipment  Failure  Causes0 


5 

A.  Dantowitz,  G.  Hirschberger , and  D.  Pravidlo, 
"Analysis  of  Aeronautical  Equipment  Environmental  Failures, 
Technical  Report  AFFDL-TR-71-22 , Air  Force  Flight  Dynamics 
Laboratory,  Air  Force  Systems  Command,  Wr ight-Patterson  Air 
Force  Base,  Ohio,  May  1971. 
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RIW  attempts  to  solve  this  problem  by  obligating  the 
contractor  to  repair  all  equipment  that  is  returned  to  him 
during  the  warranty  period  for  a fixed  price.  Although 
certain  failure  classifications  may  be  excluded,  the  effect 
of  RIW  is  that  the  contractor  must  consider  the  field  relia- 
bility of  his  equipment.  In  order  to  make  a profit,  the 
contractor  must  analyze  these  failures  and  improve  the 
reliability  of  the  equipment  through  ECPs.  Extensive 
environmental,  operational  and  field  data  is  provided  to 
the  contractor  to  aid  his  effort. 

Since  any  corrective  maintenance  action  in  the  field 
constitutes  a field  failure,  fewer  exclusions  force  the 
contractor  to  deal  with  a more  realistic  approximation  of 
the  actual  field  failure  rate.  Even  with  a large  number 
of  exclusions  this  rate  is  more  reflective  of  the  actual 
field  failure  rate  than  the  old  method  of  specifying  inherent 
design  MTBF  since  more  failure  categories  are  included. 

B.  IMPACT  OF  RIW  ON  COMBAT  EFFECTIVENESS 

Combat  effectiveness  can  be  defined  as  the  product  of 
three  factors;  performance  of  the  system,  the  availability 
of  the  system,  and  the  mission  reliability  of  the  system. 

RIW  impacts  on  the  latter  two  components  (Figure  5) . 
Availability,  which  is  a probability  measure  of  the  system 
being  up  when  it  is  needed,  is  defined  as  the  ratio  of  the 
equipments  up  time  (reliability)  and  its  down  time  (main- 
tainability) . Since  the  main  objective  of  RIW  is  to  increase 


Effectiveness  = Performance  x Availability  x 


Reliability 

/ 


RIW  can  impact  these 
two  components 


Availability 


MTBF  MTBF  - Common  Measure  of 

MTBF  + MTTR  Reliability 

MTTR  (Mean  time  to  repair) 
Common  Measure  of 
Maintainability 


(1)  Through  incentive  of  RIW  MTBF  can 

be  increased,  the  wider  the  warranty 
coverage  (less  exclusions)  the 
closer  MTBF  approaches  field 
MTBF 


(2)  RIVJ  indirectly  decreases  MTTR 

(a)  Built  in  test  equipment  makes  failure 
diagnosis  easy. 

(b)  Black  box  replacement  makes  field 
replacement  easy 

(c)  Fixed  price  incentive  causes  contractor 
to  try  to  keep  repairs  simple  and  cheap 

(d)  Specified  turn  around  times  keep  supply 
delays  down 


Reliability:  Electronic  components  generally  have 

constant  failure  rates.  So 
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Mechanical  systems,  unfortunately,  do  not 
exhibit  constant  failure  rates,  however, 
their  failure  rates  are  often  approximated 
by  using  a constant  failure  rate  over  a 
specified  time  interval. 

(1)  Through  incentive  of  RIW  MTBF  can  be  increased, 

the  wider  the  warranty  coverage  (less  exclusions) 
the  closer  MTBF  approaches  field  MTBF. 


Figure  5.  RIW  Impact  on  Combat  Effectiveness 
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reliability,  availability  is  also  increased.  To  a lesser 
extent  RIW  can  lead  to  a decrease  in  down  time,  further 
improving  availability.  The  mission  reliability  of  the 
system  is  a measure  of  the  probability  that  the  system  will 
remain  up  during  the  mission  duration.  Since  this  term  is 
inversely  proportional  to  the  failure  rate  and  RIW  lowers 
the  failure  rate,  this  term  is  also  increased.  Clauses  in 
new  contracts  frequently  contain  exclusions  for  damages  to 
equipment  caused  by  mishandling,  improper  installation, 
improper  operation  and  unverified  failures.  The  use  of 
these  and  similar  exclusion  cause  availability  and  relia- 
bility to  be  less  reflective  of  actual  operational  values, 
therefore,  the  most  effective  warranty,  from  the  government's 
viewpoint  is  one  that  has  no  exclusions. 

C.  IMPACT  ON  DESIGN 

The  maximum  government  benefits  would  come  from  applying 
RIW  to  procurement  of  new  equipment  because  the  contractor 
can  then  consider  reliability  in  his  design  effort  and  make 
tradeoffs  regarding  production  cost,  reliability  and  repair 
costs  where  they  will  have  their  maximum  effect.  The  equip- 
ment should,  therefore  have  an  initial  failure  rate  that  is 
lower  than  equipment  procured  under  other  methods.  This 
failure  rate  will  be  further  lowered  during  the  warranty 
period.  An  RIW  applied  to  an  overhaul  contract  is  less 
effective  in  this  regard  since  the  contractor  is  dealing 
with  an  existing  design.  Although  he  can  make  ECP ' s that 
improve  reliability'  he  can  not  alter  the  basic  design  of  the 
equi pment . 
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D.  LIFE  CYCLE  COSTS 

A general  equation  for  describing  Life  Cycle  Cost  is: 

LCC  = Research  & Development  + Production  + 

Cost  Cost 

Operating  + Support  + Retirement 
Cost  Cost  Cost 

RIW  alters  the  emphasis  the  contractor  places  on  the  first 
three  terms  on  the  right  hand  side  of  this  equation.  Under 
the  traditional  method  of  specifying  a design  MTBF  the  con- 
tractors main  concern  is  to  keep  development  and  production 
costs  as  low  as  possible.  Under  RIW,  however,  the  contractor 
is  forced  to  consider  his  repair  costs  once  the  equipment 
is  put  in  the  field.  This  effects  development  costs 
indirectly.  Development  costs  are  effected  since  the  con- 
tractor is  given  the  incentive  to  consider  reliability 
during  the  design  stage.  He  will  devote  more  effort  in  this 
direction  which  will  result  in  added  development  cost. 
Production  cost  usually  will  be  increased  also  as  better 
quality  material  is  used  and  the  contractor  uses  better 
quality  assurance  and  testing  techniques.  If  the  design 
effort  leads  the  contractor  to  develop  less  complex  equipment, 
however,  his  production  cost  could  go  down.  The  cost  of  the 
production  contract,  however,  will  be  higher  since  the  cost 
of  the  RIW  clause  will  be  added  to  the  cost  of  producing 
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the  equipment.  Operating  and  support  costs  will  be  decreased 
since  the  price  of  the  RIW  includes  repair  costs  for  the 
warranty  period.  Post  warranty  operating  and  support  costs 
should  also  be  decreased  since  the  RIW  acts  to  increase 
reliability . 

The  overall  effect  of  a RIW  contract  should  be  to  drive 
the  total  costs  of  the  system  toward  the  low  point  on  the 
total  cost  curve  (Figure  6) . Applying  RIW  to  a contract 
does  not  guarantee  reaching  this  point,  however.  The 
answer  lies  in  performing  an  accurate  economic  analysis  to 

! 

i determine  the  cost  savings  that  are  expected  prior  to  appli- 

cation and  choosing  the  least  expensive  alternative.  If 
the  RIW  alternative  is  chosen  another  evaluation  can  be  per- 
formed to  determine  the  actual  cost  savings  at  the  end  of 
the  warranty  period. 

Although  an  RIW  may  not  reduce  system  life  cycle  cost, 
it  does  have  the  benefit  of  providing  more  certainty  con- 
cerning repair  cost  over  the  warranty  period.  This  factor 
coupled  with  the  increase  in  field  reliability  provided  by 
RIW  is  a considerable  benefit  that  is  hard  to  measure  in 
monetary  terms  but  should  also  be  considered  in  determining 
if  a RIW  should  be  used. 

E.  INDUSTRY  CONCERNS 

The  Council  of  Defense  and  Space  Industry  Association 
(CODSIA)  has  been  the  primary  spokesman  for  expressing 
industry  concerns  over  use  of  RIW.  The  primary  concern 
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expressed  by  this  group  revolves  around  the  monetary  risk 
the  contractor  is  exposed  to  when  an  F.IW  is  used.  The 
risk  is  greatest  when  RIW  is  applied  to  the  first  production 
contract  of  new  "state  of  the  art"  equipment  since  no  actual 
field  failure  data  is  available  and  the  uncertainty  in 
predicting  the  expected  field  failure  rate  is  high.  Con- 
versely this  is  the  type  of  equipment  where  the  government 
expects  to  gain  the  most  from  RIW  application  (Figure  7). 

The  uncertainty  in  predicting  the  field  failure  rate  is 
increased  by  the  "broadness  of  the  warranty"  since  failures 
due  to  other  than  inherent  design  defects  become  increasingly 
difficult  to  predict.  Industry,  therefore,  would  prefer 
RIW  warranties  w'ith  a large  number  of  exclusions.  The 
government,  on  the  other  hand,  prefers  a broad  warranty 
since  it  has  a greater  impact  on  field  reliability  and  is 
easier  to  administer.  The  opposite  positions  of  the  govern- 
ment and  industry  are  depicted  in  Figure  8. 

If  new  equipment  were  to  be  covered  by  RIW,  CODSIA  has 
proposed  the  use  of  a cost  plus  incentive  fee  type  contract 
to  cover  initial  production.  The  incentive  fee  would  be 
based  on  meeting  a target  MTBF.  A fixed  price  RIW  would 
then  be  applied  to  the  equipment  after  field  failure  rate 
data  becomes  available.  Industry  also  feels  that  RIW’  con- 
tracts provide  harsh  penalties  if  specified  turnaround  times 
are  not  met.  These  penalties  usually  obligate  the  contractor 
to  assign  extra  spares  to  the  government,  at  no  additional 
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Type  of  Uncertainty  Contractor  Impact  on  Benefits 

Equipment  in  failure  monetary  Design  to 

rate  risk  Reliability  Government 


New  "state  of  HIGH 

art"  for  new 

use 

"State  of  Art" 
improvement 
over  similar 
equipment 

Mew  application 
of  "off  the 
shelf"  cormercial 
equipment 

New  procurement 
for  new  use  of 
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in  field 

Overhaul  Contract 
no  new 

procurement  LCW 
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Figure  7.  Contractor  Risk  and  Government 
Benefits  for  Differing  Types  of 
Equipment  Covered  by  RIW 
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Many  None 

Induced 

Faulty  Maintenance 
Faulty  Installation 
False  Removals 
Improper  Operation 
Fire,  Flood,  Crash 
etc. 

Ficrure  8.  Contrast  of  Covernment  Benefits  - Contractor 
Risk  with  Differing  Equipment  Type  and 
Contract  Exclusions 


33 


■M  ■■■ 


cost,  until  the  turnaround  time  improves  or  assess  the 
contractor  monetary  penalty  for  each  day  late.  The 
penalties  are  made  even  harsher  by  a RIW  contract  that 
includes  a MTBF  guarantee  since  if  the  MTBF  values  are  not 
met,  additional  spares  must  be  provided  until  the  MTBF  is 
improved . 

The  government  desires  these  features  in  a RIW  contract 
since  a short  turnaround  time  decreases  its  need  for  spares. 
The  inclusion  of  a MTBF  guarantee  in  a RIW  contract  also 
affords  added  protection  to  the  government.  Specif ically» 
it  may  force  the  contractor  to  make  an  ECP  to  meet  the  stated 
MTBF,  whereas,  under  a straight  RIW  the  contractor  may  choose 
not  to  make  the  change  since  it  would  be  less  expensive  for 
him  to  continue  making  repairs.  This  is  especially  true 
near  the  end  of  a warranty  period  where  an  ECP  is  less  cost 
effective  for  the  contractor.  The  differing  viewpoints  of 
industry  and  the  government  are  depicted  in  Table  2. 
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Table  2.  Government  and  Contractor  Positions  on  RIV; 


Government 


1.  Maximum  benefits  when 
applied  to  new 
equipment 

2.  Apply  to  first  production 
contract 


3.  Minimum  exclusions  - best 
warranty  the  broadest 
warranty 


4.  Firm  fixed  price  provides 
max  incentive 

5.  Use  MTE3F  guarantee  if  cost 
effective  and  appropriate 
with  RIW  as  determined  by 
an  economic  analysis  of  the 
cost  of  the  MIBF  guarantee 

G.  Short  TAT  less  expensive 
since  need  to  buy  less 
spares 
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Contractor 


1.  Would  prefer  to  apply  to 
equipment  already  in  field. 

2.  Delay  application  until  field 
data  available  (field  test 
before  warranty) 

3.  Specific  exclusions  for: 

(a)  fire 

(b)  explosion 

(c)  submersion 

(d)  flood. 

(e)  aircraft  (vehicle  crash) 

(f)  enemy  action 

(g)  seal  broken  on  unit  while 
outside  contractor's  control 

(h)  external  physical  damage 
caused  by  accident  or 
willful  mistreatment 

(i)  internal  physical  damage 
caused  by  accompanying 
external  damage  due  to 
mistreatment  or  tampering 
by  non-contractor  personnel 

(k)  induced  failures 

(l)  consequential/incidental 
damages 

(m)  unverified  failures  ("retest 
OK")  % 

(n)  improper  installation/ 
operation/maintenance  N 

(o)  designed,  developed  or 
produced  by  others  than 
warranter . 

4 . Cost  + incentive  fee  based  on 
meeting  target  MTBF. 

5.  Never  use  RIW  with  iflTlF 
guarantee 


6.  Wants  minimum  penalties  for 
exceeding  turnaround  time. 
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CONTRACT  ANALYSIS 


RIW  contracts  listed  in  Tables  3 and  4 were  evaluated 
in  terms  of  the  following  categories: 

1.  Nature  of  Equipment 

a.  New  state  of  art  for  a new  purpose. 

b.  State  of  art  improvement  over  existing  equipment. 

c.  New  military  application  of  commercial  "off 
the  shelf  equipment". 

d.  Additional  procurement  of  existing  military 
equipment . 

e.  Overhaul  contract,  applied  to  existing  military 
equipment  already  in  field. 

2.  Exclusion  clauses. 

3.  Use  of  MTBF  guaranties  and  penalties 

4 . Turnaround  time  and  penalties 

5.  Price 

6.  MTBF  improvement  realized. 

Additionally,  the  difference  in  price  between  sole  source 
and  competitive  contacts  was  compared,  the  contracts  were 
evaluated  in  terms  of  contractor  risk  and  potential  govern- 
ment benefit,  the  changes  in  RIW  application  since  the  1974 
memorandum  by  DDR&E  and  OSD(I&L)  were  analyzed  and  the  use  of 
RIW  by  the  three  armed  services  was  compared.  Finally,  the 
cost  effectiveness  of  the  only  completed  long  term  RIW  con- 
tract, the  first  USN (ASO/LSI  overhaul  contract  for  the 
AJB-3  gyro),  was  evaluated. 
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Table  3.  Long  Term  RIW  Contracts  (>4  years) 


Item  Manufacturer: 

Service 

Year 

Warranty 

Period 

CN494A/AJB-3 

LSI 

USN  (ASO) 

1967-first 

contract 

1973-second 

contract 

5 yrs/1500  hrs 
per  unit 

6 yrs/1.2  million 
total  operating 
hours 

A24G-27 

Gyro 

LSI 

USA^F 

1969 

5 yrs/3,000  hours 
per  unit 

APN-194  Radar 
Altimeter 

Honeywel 1 

USN  (ASO) 

1975-2nd 

contract 

5 years 

F-14  Hydraulic 
Pump 

ABEX 

USN  (ASO) 

1973 

6 yrs/387,000 
operating  hours 

AN/AFH118(1) 

Tacan 

Collins 

USAF 

1975 

5 years 

ARN123VOR/IIS  (1) 

Bendix 

USA 

1975 

4 years 

F— 16  ACF 
(2) 

systems 

General 

Dynamics 

USAF 

1976-under 

negotiation 

4 years/300,000 
operating  hours 

' ^ ^ Contract  includes  MTBF  guarantee 
(2) 

Contract  has  three  options:  RIW 

RIW’  with  WTBF  guarantee 
LSC~' 
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Table  4.  Short  Term  Contracts  with  RIW  Provisions 

(<26  months) 


Item  Manufacturer 

Service 

Year 

Awarded 

Warranty 

Period 

APN  154 
Fadar  Beacon 

UTE 

USN 

1972 

26  months/1000 
operating  hours 

APN  99V 
Si  Receiver 

Northrop 

USN  (NAVAIF.) 

1973 

2 years 

AAU-32A 

Barometric 

Altimeter 

Kolsiran 

USN  (NAVAIF.) 

prior  to 
1974 

2 years 

APN- 194 
Radalt 

Honeywell 

USN  (NAVAIF.) 

1972 

2 years/1500 
opera ting  hours 

INS  Carousel 

iv(1> 

Delco 

USAF 

1972 

1 year 

^ Contains  MTBF  guarantee 


The  contracts  were  separated  into  two  groups,  long  term 
(over  4 years)  and  short  term  (under  26  months)  for  purposes 
of  the  evaluation  since  the  shorter  term  contracts  do  not 
represent  full  potential  of  RIW.  These  contracts  are 
included  in  the  study,  however,  since  they  do  represent 
application  of  RIW. 

A.  CONTRACTS 

CN494A/AJB-3  Gyro,  Contr act  between  Naval  Aviation 

Supply  Office  and  Lear  Siegler  (LSI) 

This  was  the  first  military  use  of  RIW  and  represents 
the  only  completed  RIW  contract  for  which  a large  data  base 
exists.  The  contract,  signed  in  1967,  covered  the  repair  of 
800  gyros  for  a five  year  period.  The  gyros  had  been  in 
field  use  for  a number  of  years  and  were  being  repaired 
commercially  by  LSI  and  General  Electric  so  actual  field 
failure  and  cost  to  repair  data  could  be  calculated.  Addi- 
tionally, the  800  gyros  placed  under  warranty  represented 
only  about  one  third  of  the  total  gyro  population  so  a 
direct  comparison  could  be  made  between  warranted  and 
unwarranted  units.  Possible  savings  to  the  Navy  were  based 
upon  the  achievement  of  1.2  million  operating  hours  or 
1500  nrs/unit  during  the  five  year  period.  The  initial  MTBF 
was  calculated  to  be  400  hours  and  the  target  MIBF  was  set 
at  520  hours.  The  total  cost  of  the  RIW  was  estimated  to 
be  $3,444  million  based  upon  the  induction  of  800  "new" 
gyros  at  a cost  of  $4305  per  unit.  A savings  of  $686,000, 
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or  57C  per  operating  hour  was  projected.  This  contract  was 
completed  in  1973  and  a follow-on  contract  with  LSI  negotiated 
for  the  original  800  gyros.  The  follow-on  contract  has  four 
major  differences.  The  contract  price  is  lower  ($2.5 
million,  vice  $3.44  million),  operating  time  of  1.2  million 
hours  is  based  on  the  total  units  covered  and  not  limited  to 
1500  hours  per  unit,  the  calendar  time  period  has  been  ex-  . 
tended  to  six  years,  and  the  Navy  has  the  option  of  including 
additional  gyres  under  the  contract  if  it  is  seen  that  utili- 
zation will  not  meet  the  anticipated  1.2  million  operating 
hours  over  the  six  year  period  [Ref.  26].  The  cost  of  the 
second  contract  is  lower  due  to  the  reduction  in  repair  time 
which  resulted  from  reliability  improvements  made  to  the 
gyros  during  the  first  contract.  The  cost  of  the  first 
contract  was  based  on  an  average  repair  time  of  75  hours 
per  gyro.  The  cost  of  the  second  contract  was  negotiated 
with  a repair  time  of  only  45  hours. 

A24G-27  Gyro,  Contract  between  USAP  and  LSI 

In  1969  the  Air  Force  signed  a RIW  contract  with  LSI 
for  maintenance  of  128  gyros  used  in  the  Fill  aircraft. 

The  contract  is  for  a 5 year  or  3,000  operating  hours  per 
unit  period  and  was  the  result  of  a competitive  procurement 
between  LSI  and  General  Electric.  This  contract  represented 
an  additional  procurement  of  gyros  that  were  already  in 
field  use.  The  cost  effectiveness  of  the  contract  would 
therefore  be  directly  evaluated  against  non-warranted  units. 
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The  unit  production  cost  of  the  gyro  was  $6040  and  the 
warranty  cost  is  $2200  which  represents  a repair  cost  of 
7.3%  of  unit  price  per  year  [Ref.  15]. 

F-14  Engine  Driven  Hydraulic  Pump,  Contract  between 

USN  (ASO)  and  Abex  Corporation 

This  six  year/387,000  operating  hour  contract  was 
negotiated  in  1973  and  covered  258  units  at  a cost  of 
$1016  per  unit  per  year.  It  was  significant  for  several 
reasons.  Although  ABEX  had  considerable  field  experiences 
with  hydraulic  pumps  this  pump  was  larger  and  represented 
a new  state  of  the  art  design.  The  contract  is  the  broadest 
warranty  under  RIW  to  date  in  that  ABEX  agreed  to  repair 
all  pumps  returned  to  them  with  no  exclusions.  It  incor- 
porated a pool  arrangement  in  which  the  contractor  kept  a 
supply  of  ready  to  issue  pumps  on  hand  in  order  to  meet  a 
24  hour  turnaround  time  from  notification  of  a failure  until 
a replacement  pump  was  sent  from  the  factory.  The  contract 
price  was  based  on  an  expected  MTBF  of  500  hours  during  the 
first  year  growing  to  750  hours  in  the  last  year  [Ref.  25]. 

APN  194  Radar  Altimeter,  Contract  between  USN  and 

Honeywell  Corporation 

The  initial  procurement  contract  awarded  to  Honeywell 
for  the  APN-194  contained  an  RIW  clause.  The  period  of 
coverage  under  this  contract  was  for  two  years  or  1500  hours 
per  unit  and  the  cost  of  the  warranty  has  been  estimated  to 
be  about  7%  of  the  purchase  price.  The  APN-194  was  a new 
radar  altimeter  intended  to  replace  the  APN-141  which  was 
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experiencing  a 50  hour  MTBF.  Although  tfyis  contract  had  an 
RIW  clause  it  was  basically  a maintenance  service  contract 
since  it  covered  a short  time  period  (2  years)  and  the  cost 
of  ECP's  was  jointly  shared  by  Honeywell  and  the  Navy. 

ASO  has  recently  negotiated  with  Honeywell  to  provide 
a long  term  (5  year)  RIW  contract  for  the  APN-194.  The 
current  MTBF  of  the  unit  is  estimated  to  be  about  465  hours. 
Under  the  RIW  this  MTBF  is  projected  to  grow  to  over  1040 
hours  at  the  end  of  the  five  year  period  [Ref.  26]. 

AN/ARN-118  Tacan,  Contract  between  USAF  and  Rockwell 

Collins  Radio 

This  contn^t  was  signed  in  July  1975  and  was  the  out- 
come of  a design  to  cost  competition  between  Collins  and 
General  Dynamics/Electronics.  The  winning  Collins  bid  was 
$9,400  per  tacan,  with  an  additional  $500  per  year  per  set 
for  a period  of  five  years  under  RIW.  The  initial  contract 
calls  for  the  coverage  of  1000  units,  with  additional 
multi  year  options  of  7,300  units.  The  tacan  is  a state 
of  art  improvement  over  existing  tacan  sets.  The  RIW 
agreement  contains  a MTBF  guarantee  of  500  hours  for  the 
first  twelve  months,  625  hours  for  months  13-24  and  800 
hours  for  months  25-48.  If  the  field  MTBF  falls  below  these 
levels  Collins  is  required  to  supply  additional  spares  to 
the  Air  Force  with  no  charge  as  well  as  making  design 
changes  to  increase  reliability  [Ref.  8], 
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AN/ARN  12  3 VO P. -Contract  between  USA  and  Bendix 


Bendix  v/on  this  competitive  procurement  for  1,139  VOR 
sets  over  four  other  bidders  and  signed  the  contract  in 
1975.  The  contract  covers  a four  year  period  and  like  the 
Air  Force  tacan  contract  includes  a MTBF  guarantee.  The 
VOR  set  is  required  to  demonstrate  a field  MTBF  of  509  hours 
for  the  first  year,  rising  to  600  hours  during  the  second 
year  and  700  hours  for  the  third  year.  If  these  values  are 
not  met  Bendix  must  determine  the  cause,  take  corrective 
action,  and  conduct  additional  environmental  testing  at 
no  charge  [Ref.  16].  The  ARN  123  is  a standard  commercial 
unit  that  has  been  in  use  in  the  civilian  environment  for 
several  years,  however,  this  is  the  first  military  applica- 
tion. Even  with  the  MTBF  guarantee  the  unit  per  year  cost 
of  the  RIW  is  only  2.7%  of  the  purchase  price,  the  lowest 
percentage  price  for  any  military  RIW  agreement.  This  low 
figure  is  representative  of  the  high  confidence  Bend  lx  has 
in  the  unit  which  has  exhibited  a MTBF  of  greater  than  1000 
hours  in  the  civilian  environment  [Ref.  22], 

F-16  Components,  Contract  between  USAF  and  General  Dynamics 
The  most  ambitious  RIW  proposal  to  data  is  currently 
under  negotiation.  The  contract  could  call  tor  RIW  coverage 
for  up  to  twelve  critical  subsystems  which  have  been  defined 
as  contol  first  line  units  (FLUs).  The  contract  could  apply 
any  of  three  different  concepts.  RIW  with  a provision  for 
turnaround  tire,  riw  with  a MTBB  guarantee,  and  a comparison 


between  Target  Logistic  Cost  and  measured  Logistic  Support 
Cost.  Under  the  latter  concept  the  actual  logistic  support 
cost  will  be  computed  based  on  data  accumulated  during  a 
verification  test  of  3500  flight  hours.  The  test  will 
commence  six  months  after  the  first  F-16  squadron  becomes 
operational.  If  the  measured  value  does  not  exceed  the  target 
value,  the  contractor  is  eligible  for  an  award  fee.  If  the 
total  measured  value  exceeds  the  total  target  value  by  greater 
than  25%  the  contractor  must  initiate  a correction  of 
deficiencies  (COD) . 

Under  the  RIW  option,  the  warranty  period  is  48  months 
or  300,000  flight  hours,  whichever  comes  first  and  the  Air 
Force  reserves  the  option  to  extend  the  contract  in  incre- 
ments of  24  months  or  equivalent  flying  hours.  The  contract 
specifies  a maximum  of  twenty  two  days  between  contractor 
receipt  of  a failed  FLU  and  placement  of  the  repaired  item 
in  a secure  storage  area.  The  contractor  must  provide 
extra  spares  if  the  turnaround  time  is  exceeded. 

The  RIW  with  a MTBF  guarantee  option  provides  for  tour 
penalties  if  the  computed  MTBF  for  a given  measurement  period 
is  less  than  the  guarantee  value  for  that  period.  The 
contractor  is  obligated  to: 

1.  Perform  engineering  analysis  to  identify  the  cause 
of  noncompliance. 

7 . Initiate  corrective  ECPs. 

3.  Modify  existing  units  in  accordance  with  approved 
changes . 
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4.  Provide  additional  spares  on  a loan  basis  until 
guaranteed  MTBF ' s are  met. 

Both  RIW  options  are  under  Separate  Firmed  Fixed  Price 
proposals  while  the  LSC  option  is  on  a Cost  Plus  Incentive 
fee  basis  [Ref.  24]. 

B.  SHORT  TERM  CONTRACTS 

Several  other  contracts  have  included  RIW  provisions 
(Table  4),  however,  these  are  basically  maintenance  service 
type  contracts  for  short  time  periods  (26  months  or  less) . 
The  short  time  period  of  these  contracts  does  not  provide 
any  incentive  for  the  contractor  to  initiate  any  but  the 
least  expensive  ECP ' s since  the  number  of  repairs  he  would 
reduce  by  initiating  an  ECP  would  not  offset  the  cost  of 
the  ECP.  These  contracts,  therefore,  do  not  have  an  incen- 
tive for  the  contractor  to  improve  reliability  during  the 
warranty  period  and  are  not  RIW's  in  the  strict  sense. 

They  do  offer  insurance  to  the  government,  however,  in  that 
the  contractor  would  lose  money  on  the  cost  of  repairs  if 
the  number  of  actual  repairs  exceeded  the  number  that  was 
used  in  pricing  the  warranty  agreement.  The  contractor 
therefore  has  a strong  incentive  to  provide  equipment  that 
has  an  initially  high  reliability.  Another  advantage  to 
the  government  is  knowing  that  repair  costs  for  the 
warranty  period  are  fixed. 
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c. 


TYPES  OF  EQUIPMENT  WARRANTED 


•Of  the  eight  long  term  (greater  than  4 years)  RIWT  con- 
tracts now  in  force  or  under  negotiation  three  are  overhaul 
contracts,  one  is  an  additional  procurement  of  existing 
military  equipment,  one  is  a new  military  application  of 
commercial  equipment,  two  are  applied  to  equipment  that  is 
a state  of  the  art  improvement  over  existing  equipment,  and 
one  (F-16)  covers  units  ranging  from  new  procurements  of 
existing  equipment  to  state  of  the  art  equipment  improvements 
(Table  5).  Of  the  five  short  term  contracts,  three  were  for 
additional  procurements  of  existing  equipment,  one  for  an 
equipment  that  was  a state  of  the  art  improvement  over 
existing  equipment,  and  one  a new  military  application  of 
commercial  equipment. 

When  the  contracts  are  identified  by  the  military  service 
(Table  6) , it  is  clear  that  the  Navy  has  applied  RIW  pri- 
marily to  overhaul  contracts  for  long  term  RIW,  while  the 
Air  Force  has  used  the  concept  for  production  contracts. 

The  Navy  procurement  contracts  that  have  used  RIW  are  pri- 
marily for  a short  term  period  ( < 2 6 months)  , except  for  the 
ABEX  contract,  and  are  basically  maintenance  service  con- 
tracts. The  lone  Army  application  was  a procurement  of  an 
"off  the  shelf"  commercial  item. 

D.  EXCLUSION  CLAUSES 


The  basic  exclusion  clause  in  most  RIW  contracts  to 
date  has  included  exclusions  for: 


Table 

5.  Types  of  Equipment 

Warranted 

Long  Term  (>4  years) 
RIW  Contracts 

Short  Term  ( <26  months) 
Contracts  Containing 
RIW  Provisions 

New  "state  of  art" 
for  new  use 

- 

- 

State  of  Art 
Improvement 
over  Similar 
Equipment 

F-14  Hydraulic  Pump 

AN/ARN  118  Tacan 
F-16  Components 

APN-194  Radar  Altimeter 
(1st  contract) 

New  Application 
of  "off  the  shelf" 
cannercial 
equipment 

AN/ARN  123  VOR 
F-16  Components 

INS  Carousel  TV 

New  Procurement 
for  New  Use  of 
Equipment 
Already  In  Field 

A24G-27  Gyro 
F-16  Components 

APN  154  Radar  Beacon 

AAU-3A  Barometric 
Altimeter 

ARN99V  Cmega  Receiver 

CN494A/AJB-3  Gyro 
(two  contracts) 

I 


Overhaul  Contract 
Mo  New  Procurement 


APN-194  Radar  Altimeter 
(2nd  Contract) 


Table  6. 


Service  Use  of  Warranties 


Long  Term  (>4  years) 
RIW  Contracts 


Short  Term  (<26  monts) 
Contracts  Containing 
RIW  Provisions 


USN  USAF  USA  USN  USAF  USA 


Mew  "state  of 
art"  for  new 
use 

- 

- 

"State  of  Art" 

F-14  AN/AEN 

APN-194  - 

Improvement 

I!ydraulic  118 

Padar 

over  similar 

Pump  Tacan 

Altimeter 

equipment 

F-16 

(1st 

Components 

contract) 

New 

F-16  AN/AEN 

- INS  - 

application 

ccrrpon-  12  3 VOR 

Carousel 

of  "off  the 
shelf" 
commercial 
equipment 

ents 

IV 

New 

A24G-27 

APN  154  - 

Procurement 

Gyro 

Radar 

for  new  use 
of  equipment 

F-16 

Beacon 

AAU-3A 

Barometric 

Altimeter 

already  in 
field 

Carponents 

AEN99V 

Omega 

Receiver 

Overhaul 

CTI494A/ 

contract 

AJB-3 

No  New 

Gyro  (two 

Trocure- 

contracts) 

ment 

APN-194 

Padar 

Altimeter 

(2nd 

contract) 
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1. 


fire 


2.  explosion 

3.  submersion 

4.  crash 

5.  enemy  action 

6.  damage  caused  by  mishandling,  improper 
installation,  improper  operation,  and  accident 

7.  broken  seal  on  unit. 

The  lone  exception  to  these  types  of  exclusions  is  the 
contract  covering  the  ABEX  hydraulic  pump  for  the  F-14 
aircraft  which  contains  the  clause: 

"In  the  event  a warranted  unit  is  lost  or 
destroyed,  an  additional  government  owned  unit 
will  be  introduced  into  the  warranty  population 
and  will  assume  the  unexpired  warranty  of  the 
unit  lost  or  destroyed  at  no  increase  in  contract 
price.  If  such  replacement  is  not  possible  (e.g., 
because  all  existing  units  are  covered  by  similar 
warranty)  the  U.S.  Navy  may  elect  to  procure  a 
replacement  unit  or  the  parties  hereunder  may 
negotiate  an  appropriate  extension  of  the 
calendar  limitations."  [Ref.  14] 

The  number  of  items  that  would  normally  fall  under  these 
exclusions,  however,  are  limited  and  will  generally  not 
have  a large  impact  on  the  number  of  returns  the  contractor 
must  process  and  repair. 

A major  item  that  can  effect  contractor  costs  under  RIW 
is  the  return  of  units  that  "test  good."  A large  number 
of  these  unverified  failures  significantly  raise  costs  to 
the  contractor  since  he  must  test  and  process  all  units 
returned  to  him.  If  the  contract  contains  an  MTBF  guarantee, 
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the  contractor  is  also  penalized  if  unverified  failures  are 
included  in  calculating  the  field  MTBF  of  the  equipment. 

RIW  contracts,  with  the  exception  of  those  including  a 
MTBF  guarantee,  have  not  included  special  provisions  for 
unverified  failures.  The  number  of  unverified  failures  for 
the  equipment  that  have  occurred  in  the  past  (if  field 
data  is  available)  or  an  estimate  of  the  number  of  unveri- 
fied failures  is  usually  used  in  calculating  the  price  of 
the  RIW.  The  government  indirectly  pays  this  price  when 
it  purchases  the  RIW.  This  provides  the  contractor  the 
opportunity  to  increase  his  profit  if  he  can  lower  the  rate 
of  unverified  failure  returns.  Contracts  containing  a 
MTBF  guarantee  have  excluded  unverified  failures  from  the 
MTBF  calculation  and  have,  in  two  of  four  cases,  contained 
a provision  to  pay  a fixed  fee  per  unit  if  unverified 
failures  exceeded  a specified  rate.  The  use  of  exclusions 
is  summarized  in  Table  7. 

F.  MTBF  GUARANTEES  AND  PENALTIES 

>0  RIW  contracts  containing  MTBF  guarantees  have 
recently  been  signed.  One  by  the  Army  for  procurement  of 
An/ARN-123  VOR  navigational  equipment  and  one  by  the  Air 
Force  for  procurement  of  a new  generation  Tacan  set. 
Additionally  the  proposed  contract  for  the  F-16  fighter  has 
an  MTBF  guarantee  option  to  cover  up  to  12  control  FLU's. 

An  earlier  procurement  of  inertial  navigational  equipment 
by  the  £ir  Force  also  contained  a MTBF  guarantee.  The. 
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Table  7.  Use  of  Exclusions 


Standard  Exclusion  Standard  No. 

and  provision  for  ,, > Exclusion  Exclusions 

unverified  failures v 

(2) 

AN/ARN-123  VOR  ' WB-3  Gyro  Abex 

(both  contracts)  hydraulic 
pump. 

AFN-194  Radalt 
(second  contract) 

A24G-27  Gyro 

(3) 

F-16  components 

APN-194  (1st  contract) 

APN-154  Radar  Beacon 
AKN  99V  fi  Receiver 
AAU-32A  Bara It 

(2) 

INS  Carousel  (IV) 


^government  will  reimburse  contractor  $100  for  every'  unverified 
failure  over  309 . 

(2) 

NTTBF  guarantee  - unverified  failures  not  counted. 

(3)NTTBF  guarantee  option  unverified  failures  not  counted. 


AN/AKN-118 
Tacan (2) 


Short 

term 

RIW 

provision 
(<26  mos) 


Long 
term 
RIW 
>4  yrs 
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guaranteed  MTBF  values  and  associated  penalties  to  be 
evoked  if  the  specified  values  are  not  met  are  summarized 
in  Table  8.  The  penalty  clauses  used  are  virtually  identi- 
cal. They  provide  for  identification  of  the  cause  of 
failures,  corrective  no  cost  ECP ' s , and  providing  additional 
spares  until  stated  MTBF ' s are  met. 

Under  a straight  RIW  the  contractor  has  the  option  of 
improving  the  reliability  of  the  equipment  or  of  repairing 
more  units  if  the  reliability  is  not  improved.  The  latter 
choice  may  be  more  cost  effective  to  him  especially  during 
the  later  stages  of  the  warranty  period.  The  MTBF  guarantee 
removes  this  option  by  evoking  a heavy  penalty  by  use  of 
the  provision  for  providing  additional  spares  at  no  cost 
to  the  government.  From  a contractor's  standpoint,  therefore, 
there  is  a high  degree  of  monetary  risk  involved  in  a 
contract  containing  a MTBF  guarantee  than  in  a straight 
RIW  fc:  the  same  equipment. 

F.  TURNAROUND  TIME  PROVISIONS 

Turnaround  time  is  important  to  the  government  since 
it  has  a direct  impact  on  the  availability  of  the  equipment 
in  the  fleet.  If  MTBF  is  constant  and  turnaround  time 
increases, the  field  availability  will  decrease  due  to  spares 
not  being  in  stock.  Availability  can  be  increased  by  an 
increase  in  the  amount  of  spares  available,  however,  this 
is  achieved  at  the  expense  of  buying  additional  spares. 


Table  8.  NTTBF  Guarantees  and  Pena1 ties 


Item. 

Guaranteed  PTBF 

Penalty 

(hours) 

_ 

AN/AKN-123  TOR 

1st  year  - 500 

Engineering  analysis  to  determine 

2nd  year  - 600 

cause,  corrective  ECP's, 

3rd  year  - 700 

additional  environmental  testing 

AN/AFN-118 

1-12  months  - 

500 

Supply  additional  spares  at  no 

Tacan 

13-24  months  - 

625 

cost  determine  cause  corrective 

25-48  months  - 

800 

ECP's 

F-16  Components 

PiW/MTHF  Guarantee  option 

Inert i al 

1-12  months  - 

185 

Engineering  analysis  to  determine 

Navigational 

13-24  months  - 

284 

causes,  corrective  ECP's,  provide 

Unit 

25-36  months  - 

300 

additional  spares  according  bo  formula 

Flight 

1-12  norths  - 

162 

II  It 

Control 

13-24  months  - 

242 

Computer 

25-48  months  - 

260 

Radar 

1-12  months  - 

155 

II  II 

E/0 

13-24  months  - 

228 

Display 

25-48  months  - 

244 

HUD 

1-12  months  - 

170 

It  II 

Display 

13-24  months  - 

212 

25-4P  months  - 

224 

Digital 

1-12  months  - 

210 

II  II 

Scan 

13-24  months  - 

330 

Converter 

25-48  months  - 

350 

Fire 

1-12  months  - 

415 

II  II 

Control 

13-24  months  - 

600 

Canputer 

25-48  months  - 

640 

HUD 

1-12  months  - 

325 

II  II 

Electronics 

13-24  months  - 

470 

25-48  months  - 

500 

E/0 

1-12  nontns  - 

155 

It  — 

Display 

13-24  months  - 

228 

Electronics 

25-48  months  - 

244 

JNS  Carousel  _I\T 

After  6 months  - 1100 

Improve  system  until  MTEF  value 

met,  provide  additional  spares 

at  1/2  cost 

(1) 


The  NTTBF  guarantee  is  me ^ if  field  MTBF  meets  or  exceeds  specified 
NfTBF  for  two  consecutive  6 month  periods  but  no  earlier  than  the 
2-1/2  year  point. 


e 

Specified  contractor  turnaround  times  and  associated 
penalties  are  listed  in  Table  9.  Turnaround  times  range 
from  24  hours  for  the  F-14  hydraulic  pump  to  a high  of  60 
days  for  the  ARN  99V  ft  Receiver.  The  extremely  short 
turnaround  time  for  the  F-14  hydraulic  pump  is  made  possible 
by  designating  25  of  the  258  pumps  procured  as  rotatable 
pool  items  that  are  kept  "on  the  shelf"  at  the  contractor's 
plant.  Penalties  associated  with  not  meeting  specified 
turnaround  time  fall  into  three  categories;  warranty  exten- 
sion, monetary  penalty,  or  provision  of  additional  spares. 
The  warranty  extension  is  probably  the  least  effective 
penalty  and  causes  additional  detailed  bookkeeping,  while 
the  provision  for  additional  spares  is  the  most  effective 
since  this  helps  to  offset  the  lowered  field  availability 
caused  by  the  increased  turnaround  time. 

G.  COST  OF  RIW 

The  cost  of  a RIW  is  frequently  stated  as  a percentage 
derived  from  dividing  the  yearly  warranty  cost  per  unit  by 
the  original  unit  procurement  cost.  This  method  does  not 
take  into  account  differences  in  the  terms  and  conditions  of 
the  individual  warranties,  which  can  effect  the  cost  of  the 
RIW.  It  does,  however,  offer  a simple  method  of  comparing 
the  cost  of  RIW  contracts.  It  also  presents  a guideline 
evaluating  the  cost  of  similar  warranty  provisions  and 
establishing  a price  range.  The  cost  of  each  RIW  contract 
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Table  9.  Turnaround  Time 


Item 

TAT 

Penalty 

AJB-3  gyro 
(2  contracts) 

45-60  days 

- 

F-14  Hudraulic  pump 

24  hr. 

warranty  extended  2 
days  for  each  day 
over  72  hours 

Long 

term 

AN/AFN  123  VOR 

20  days 

$10  per  day  for  each 
day  over  20 

RIW 

contracts 
(>4  yrs) 

AN/ARM  118  Tacan 

20  days 

$25  per  day  for  each 
day  over  20 

A-24G-27  gyro 

45  days 

— 

APN-194  Rad  AH 
(2nd  contract) 

- 

— 

F-16  canponents 

22  days 

contractor  provides 
additional  spares 
at  no  cost  if  not  met 

'v 

APN  194  Radalt 

45  days 

.5%  of  purchase  price 
per  day  over  45 

INS  CAROUSEL  IV 

— 

— 

Short 

term 

ARN  99V  fi  Receiver 

60  days 

— 

RIW 

AAU-32A  Baralt 

45  days 

.5%  of  purchase  price 

provisions 

per  day  over  45 

(e"26  months) 

ARN-154  Radar  Beacon 

30  days 

extension  of  warranty 
period  if  not  met 

should  be  determined  by  an  extensive  economic  analysis  which 
evaluates  the  potential  savings  to  the  government  and  also 
takes  into  account  the  potential  for  reliability  improvement. 

Table  10  documents  available  RIW  cost  figures.  From 
the  data  presented  it  appears  that  the  cost  of  RIW  has  been 
decreasing  with  time,  possibly  because  of  more  familiarity 
with  the  concept.  It  also  appears  as  if  the  Navy  has  generally 
paid  a higher  percentage  price  for  RIW  than  have  the  other 
services  but  this  may  be  due  to  the  reasons  stated  above. 

In  general  competitive  contracts  appear  to  have  been 
less  costly.  Of  the  nine  contracts  for  which  data  was  ob- 
tained five  have  been  or  are  competitive.  The  average  per- 
centage cost  for  these  contracts  is  about  6%.  The  cost  of 
the  four  sole  source  contracts  is  &out  17%.  The  Na'  y has 
negotiated  all  four  of  the  sole  source  contracts  and  one 
competitive  contract.  While  all  Air  Force  and  Army  contracts 
have  been  competitive. 

H.  MTBF  IMPROVEMENT 

All  RIW  contracts  for  which  data  is  available  have  re- 
sulted in  reliability  growth  or  improvement  over  replaced 
systems,  expressed  as  an  increase  of  MTBF.  The  increases 
have  ranged  from  30%  to  almost  200?.,  Table  11.  Under  the 
long  term  RIW  contracts  the  contractors  have  used  no  cost 
ECP ' s to  effect  the  increase  in  reliability  for  the  AJB-3 
gyro  and  the  A24G-27  gyro.  Although  ABEX  has  originated  7 
no  cost  ECP ' s to  the  F-14  hydraulic  pump,  insufficient  data 
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Table  10.  Cost  of  RIW  [Ref.  14,  15,  16,  18] 


guarantee  option 


Table  11.  MTBF  Improvement 


I tern 

AJB-3  gyro 
(1st  contract) 

AJB-3  gyro 
(2nd  contract) 

APN-194  Rada It 
(1st  contract) 

F-14  Hydraulic  Pump 

A24G-27  gyro 

INS  Carousel  IV 
AN/ARN  123VOR 

AN/ARN  118  Tacan 

APN  154  Radar  Beacon 

APN  194  Rad  Alt 
(2nd  contract) 


MTBF  improved  from  400  hrs  to  520  hrs 
no  date 


Replaced  APN  141  which  had  MTBF  of 
50  hrs.  MTBF  achieved  450  hour 

7 no  cost  ECP's  originated,  not 
sufficient  data  for  evaluation  of 
reliability  improvement 

MTBF  over  1200  hours  for  warranted 
gyro  vice  749  hours  for  unwarranted 
unit 

MTBF  commercial  unit  was  1100  hrs 
MTBF  of  USAF  unit  was  2208  hrs 

No  data  yet,  commercial  unit  has 
MTBF  1000  hrs.  MTBF  guarantee 
value  - 700  hrs 

Replaces  AN/ARN-21/52/65/72  with  MTBF ' s 
hour 

MTBF  guarantee  value  - 800  hrs 

MTBF  improved  from  534  hrs  to  2025  hrs 

Honeywell  proposes  to  increase 
MTBF  from  480  - 1110  hrs 
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is  available  to  determine  reliability  improvement.  The 
dramatic  increases  in  the  MTBF's  of  the  INS  Carousel  IV 
and  the  APN  154  Radar  Beacon,  both  short  term  contracts, 
were  the  result  of  changes  incorporated  in  the  production 
of  the  units  rather  than  any  changes  made  in  the  units 
after  they  were  deployed. 

I.  RELATIONSHIP  BETWEEN  CONTRACTOR  RISK  AND  RIW  PRICE 

If  new  equipment,  with  no  field  failure  data,  provides 
the  greatest  monetary  risk  for  the  contractor,  this  risk 
should  be  reflected  in  the  RIW  price  and  in  the  contract 
exclusions.  Data  for  the  eight  long  term  RIW  contracts  does 
not  substantiate  this  assumption.  The  two  most  expensive 
(calculated  on  a percentage  basis)  RIW  contracts  have  been 
for  overhaul  contiurts  where  extensive  field  failure  and 
repair  cost  data  was  available.  The  broadest  warranty  to 
date,  for  the  F-14  hydraulic  pump  had  a high  percentage 
cost  but  also  had  the  shortest  turnaround  period.  The  use 
of  a MTBF  guarantee  in  the  AN/ARN  118  Tacan  and  AN/ARN  123 
VO R contracts  did  not  appear  to  raise  the  cost  of  these 
warranties  to  a high  level.  The  F-16  proposal  shows  that 
using  an  MTBF  guarantee  would  raise  the  price  of  the  warranty 
by  12%  to  93°  depending  on  the  component  warranted  which 
indicates  that  a MTBF  guarantee  is  more  costly  than  a 
straight  RIW.  Warranty  contracts  for  the  "riskier"  equipment 
also  contain  more  penalty  provisions  with  regard  to 
turnaround  time  (Table  12). 


Table  12.  Contractor  Risk;  long  Term  RIW  Contracts 
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Although  pricing  data  concerning  the  short  terra  RIW 
contracts  (Table  13)  is  lacking,  there  seem  to  be  no  par- 
ticular differences  in  exclusions  or  penalties  between  the 
"high"  and  "low"  risk  equipment. 

J.  COMPETITION 

RIW  contracts  that  have  been  competitive  have  been 
negotiated  for  a lower  percentage  cost  than  those  that  have 
been  the  result  of  a sole  source  negotiation.  Of  the  nine 
contracts  for  which  data  was  obtained  four  have  been  sole 
source  and  five  have  been  competitive.  The  average  percen- 
tage price  of  a sole  source  contract  has  been  over  17% 
while  the  average  percentage  price  of  a competitive  contract 
has  been  5.8%,  Table  14.  The  Navy  has  been  the  only  service 
to  apply  sole  source  RIW  contracts,  it  has  also  payed  a 
higher  percentage  cost  for  warranties. 

K.  TRENDS  IN  RIW  CONTRACTING 

The  DDR&E  and  OSD(I&L)  memo  of  August  1974  establishing 
guidelines  for  RIW  seems  to  have  stimulated  the  use  of  RIW 
(Table  15) . All  RIW  contracts  since  1974  have  been  for  long 
(4  years  or  greater)  time  periods.  The  Air  Force,  in  par- 
ticular, has  attempted  to  apply  the  technique  to  new  procure- 
ments. The  contracts  for  the  ARN-118  Tacan  and  the  proposed 
contract  for  F-16  components  are  applications  which  offer 
the  maximum  benefits  to  the  government.  The  F-16  contract 
is  the  most  significant  potential  application  of  RIW  to 
date.  The  avionic  subsystems  covered  by  a RIW  option 
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Table  13.  Contractor  Risk;  Short  Term  RIW  Contracts 


Risk  Price 

High  7% 


Equipment 

APN-194  Rada It 
(1st  contract) 


Turnaround  Time, 
Penalties 


45  day  TAT  with 
penalty 


8 .3% 


INS  Carousel  MTBF  guarantee 
IV  with  penalty 


Low 


APN  154  Radar 
Beacon 

AAU-3A  Baralt 


ARN  99V  S 
Receiver 


30  day  TAT  with 
penalty 

45  TAT  with 
penalty 

60  day  TAT 
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Table  14:  Competitive  - Sole  Source 

Contracts  by  Service 


Long  Term  (>4  years)  RIW  Contracts 


Item  % Price  Type  Service 


AJB-3  Gyro 
(1st  contract) 

33% 

Sole  Source 

USN 

AJB-3  Gyro 
(2nd  contract) 

16.7% 

Sole  Source 

USN 

F- 14  Hydraulic 
Pump 

16% 

Sole  Source 

USN 

APN-194  Radar 
Altimeter 
(2nd  contract) 

3%  (est . ) 

Sole  Source 

USN 

Average  Sole  Source 

17.2% 

A24G-27  Gyro 

7.3% 

Competitive 

USAF 

F-16  Components 

4-10% (RIW) 

Competitive 

USAF 

AN/ARN  118  Tacan 

4 . 8% 

Competitive 

USAF 

AN /ARM  123  VOR 

2.7% 

Competitive 

USA 

Average  Competitive 

5.8% 
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Table  15.  RIW  Contracts  by  Year 


Year 

Item 

Warranty 

Period 

Type 

Contract 

Service 

1967 

AJB-3  Gyro 

5 yr 

overhaul 

USN 

1969 

A24G-27  Gyro 

5 yr 

New  Procurement 
existing  equipment 

USAF 

1972 

APN  154 

26  mos. 

new  procurement 
existing  equipment 

USN 

APN  194 
Radalt 

2 yr 

new  procurement 
state  of  art 
improvement 

USN 

INS  Carousel 

iv(1) 

1 yr 

new  procurement 
commercial 
equipment 

USAF 

1973 

ARN  99V 
Receiver 

2 yr 

new  procurement 
existing  equipment 

USN 

F-14  hydraulic 
pump 

6 yr 

new  procurement 
state  of  art 
improvement 

USN 

AJE-3  gyro 

6 yr 

overhaul 

USN 

1974 

(prior  to) 

AAU-32A  Earalt 

2 yr 

new  procurement 
existing  equipment 

USN 

1975 

AN/ARN  118 
Tacan^ 

5 yr 

new  procurement 
state  of  art 
improvement 

USAF 

ARN  123  VDP/ 
ILS(1) 

4 yr 

new  procurement  USA 

commercial  equipment 

1976 

APN-194  Radalt 

5 yr 

overhaul 

USN 

F-16  components 
(proposed) 

(2)  . 

4 yr 

new  procurement 
mix  of  systems 

USAF 

^ Includes  MTBF  guarantee 

^ Includes  RIW  option  and  RIW/NTTBF  ciuarantee  option 


represent  the  major  cost-maintenance  items  in  the  program. 
This  is  also  the  first  attempt  to  warrant  complete  sub- 
systems as  previous  warranties  have  covered  individual 
"black  boxes"  only.  The  Army's  first  attempt  at  applying 
the  RIW  concept,  the  AN/ARN  123  VOR/ILS  is  a middle  of  the 
road  approach.  The  Bendix  VOR  is  a standard  commercial 
item  that  has  been  widely  used  in  civilian  aviation  and  has 
demonstrated  a MTBF  in  excess  of  1000  hours  in  that  environ- 
ment [Ref.  22].  Meeting  the  guaranteed  MTBF  value  of  700 
hours  after  three  years  does  not  appear  to  present  much 
risk  to  the  contractor  as  represented  by  the  low  (2.7%) 
annual  maintenance  cost.  The  contract  does  provide  insurance 
to  the  Army,  howTever.  Whether  this  is  cost  effective  remains 
to  be  determined.  Of  the  three  services,  the  Navy  seems  to 
have  taken  the  least  risky  approach  to  RIW  contracting. 
Although  the  RIW  for  the  F-14  hydraulic  pump  was  an  ambi- 
tious contract  representing  a state  of  art  improvement  over 
existing  hydraulic  pumps  the  majority  of  the  Navy's  long 
term  RIW  contracts  have  applied  to  the  overhaul  of  existing 
equipment.  Although  the  F-18  and  LAMPS  programs  are  con- 
sidering the  use  of  RIW  both  proposals  have  left  it  to  the 
contractor  to  determine  RIW  candidates  [Ref.  22]. 

L.  COST  EFFECTIVENESS  OF  RIW 

To  date  only  one  completed  RIW  contract  (the  1967  USN 
contract  with  LSI  for  maintenance  of  800  gyroscopes)  has 
provided  comprehensive  data  concerning  cost  effectiveness. 


During  the  initial  economic  analysis  LSI  projected  a 
$780,000  cost  savings  for  the  Navy  over  the  five  year 
warranty  period.  This  savings  was  based  on  reducing  the 
maintenance  cost  of  the  warranted  gyroscopes  by  6 5 C an  hour. 

A total  of  1.2  million  operating  hours  was  predicted  over  the 
warranty  period  [Ref.  26].  The  cost  savings  were  to  accrue  due 
to  a 30%  increase  in  MTBF  over  the  five  year  period.  LSI 
calculated  that  the  cost  per  operating  hour  under  RIW  would 
be  $2.79  which  amounted  to  a $3.35  million  fixed  cost  for  the 
contract.  The  operating  cost  for  unwarranted  gyroscopes 
was  $3.44  per  hour  or  $4.13  million.  The  difference  between 
the  two  figures  ($4.13  - $3.35  million)  represented  the 
potential  savings  to  the  Navy.  The  minimum  cost  of  the 
contract,  was  based  on  inducting  800  new  configuration 
gyroscopes.  In  actuality  a mixture  of  old  and  new  units 
were  inducted  raising  the  contract  cost  to  $3,766  million. 

The  contract,  as  mentioned  previously,  was  at  fixed 
cost  and  based  on  a total  of  1.2  million  operating  hours. 

During  the  five  year  warranty  period  the  Navy  achieved 
only  85  percent  of  this  operating  hour  total  which  had  the 
effect  of  raising  the  operating  cost  per  hour.  Operating 
hours  were  less  than  projected  due  to  a decrease  in  actual 
flight  hours  and  a difference  between  the  projected  ground 
to  air  ratio  (1.63)  and  the  actual  ratio  experienced  (1.47). 
Based  on  the  reduced  operating  hour  figure  the  Navy  only 
broke  even  under  this  contract  [Ref.  26].  A potentially 
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large  savings  may  accrue  to  the  Navy  in  the  future  because 
of  the  increase  in  reliability  of  the  warranted  gyros. 
These  savings  will  be  in  the  form  of  reduced  repair  costs 
and  a reduction  in  the  number  of  space  gyroscopes  required 
to  support  the  installed  units,  however,  actual  data  to 
evaluate  these  savings  is  not  available  at  this  time. 
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TV.  CONCLUSIONS 


Since  the  majority  of  long  term  RIW  contracts  have  not 
completed  their  warranty  periods,  final  evaluation  data  is 
lacking.  Questions  concerning  cost  savings  to  the  government 
and  profits  to  industry  must  wait  for  this  data  before  they 
can  be  answered.  Nevertheless,  several  conclusions  can  be 
drawn  from  the  data  that  is  available.  RIW  contracts  have 
been  used  in  the  procurement  of  new  equipment  that  has 
incorporated  state  of  the  art  improvements  over  the  old 
equipment  that  it  was  replacing  as  well  as  to  overhaul 
contracts  that  have  sought  to  improve  the  reliability  of 
equipment  already  in  the  field. 

The  DOR&E  and  OSD(I&L)  memorandum  of  1974  urging  the 
trial  use  of  RIW  seems  to  have  achieved  this  objective. 

The  Air  Force,  in  particular,  has  negotiated  an  ambitious 
warranty  contract  for  the  AN/ARN-118  Tacan  and  is  attempting 
to  apply  RIW  in  the  procurement  of  the  F-16  fighter.  The 
Army  has  recently  entered  into  a long  term  RIW  contract  for 
the  procurement  of  new  navigation  equipment.  The  Navy's 
recent  contract  for  the  APN-194  Radar  Altimeter  represents 
a more  conservative  contract,  however,  the  Requests  for 
Proposals  for  the  F-18  fighter  and  the  LAMP'S  contain  RIW 
provisions . 

In  all  cases  for  which  data  is  available  the  inclusion 
of  a RIW  provision  in  a contract  has  resulted  in  MTBF 
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improvement.  The  question  of  cost  effectiveness,  however, 
remains  unanswered.  The  first  Navy-LSI  overhaul  contract 
for  the  AJB-3  gyro  resulted  in  a 30%  increase  in  MTBF  and  a 
reduction  in  maintenance  cost  of  20%  per  unit.  The  Navy, 
however,  did  not  realize  the  potential  cost  savings  from  the 
contract  because  of  a decrease  in  operating  hours  which 
resulted  in  fewer  failures  and  fewer  repairs.  Data  from 
other  contracts  is  lacking. 

Several  short  term,  26  month  or  less,  contracts  that 
contained  RIW  clauses,  have  resulted  in  large  MTBF  improve- 
ments. Since  these  contracts  are  basically  maintenance 
service  contracts  in  that  the  short  term  of  the  warranty 
does  not  make  no  cost  ECP ' s cost  effective  for  the  contractor, 
the  large  improvement  in  MTBF  came  from  improvements  incor- 
porated in  the  equipment  during  design  and  production.  The 
contractor  was  given  the  incentive  to  make  these  improvements 
since  he  could  raise  his  profits  by  lowering  the  number  of 
repairs  he  would  make  during  the  warranty  period.  By 
placing  a larger  emphasis  on  reliability  and  strictly  en- 
forcing reliability  design  specifications  the  saint  result 
could  be  obtained  without  the  use  of  a RIW  provision. 

Such  an  approach  might  prove  less  cumbersome  and  be  morn 
cost  effective. 

One  major  advantage  of  RIW  is  that  it  provides  the 
contractor  with  timely  and  accurate  data  concerning  the 
reliability  of  his  equipment  under  field  conditions.  This 
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enables  him  to  isolate  the  weak  points  in  his  equipment 
and  correct  them.  This  will  also  help  him  in  any  follow- 
on  designs  since  he  gets  first  hand  experience  with  the 
operating  environment.  Another  approach  that  provides  this 
type  of  information  is  comparison  of  Target  Logistic  Support 
Cost  to  Measured  Logistic  Support  Cost,  one  of  the  options 
in  the  F-16  contract.  The  total  cost  of  this  option  is 
less  than  50%  the  cost  of  the  RIW  option  and  less  than  30% 
of  the  RIW  with  MTBF  guarantee  option.  Although  this  option 
does  not  provide  the  contractor  with  an  incentive  to  improve 
reliability  over  a long  term  period,  it  does  provide  for 
an  incentive  to  keep  logistic  support  costs  low  which 
translates  to  a high  initial  reliability. 

Since  all  RIW  contracts  are  for  a specified  operating 
hour  or  calendar  time  period  the  maximum  cost  savings  to 
the  government  occur  only  when  this  operating  time  is 
achieved.  An  actual  utilization  rate  below  that  projected 
will,  at  some  point,  make  the  RIW  more  expensive  than 
organic  maintenance. 

In  using  RIW,  the  reliability  of  the  entire  weapons 
system  must  therefore  be  considered.  In  some  cases,  par- 
ticularly with  new  weapons  systems,  it  may  be  more  advan- 
tageous to  cover  a wide  variety  of  systems  under  RIW  to 
insure  an  overall  high  reliability.  An  example  of  this 
type  of  application  is  the  proposed  F-16  application. 
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ASSISTANT  SECRETARY  OF  DEFENSE 

WASHINGTON,  D C.  20J01 


INSTALLATIONS  AND  LOGISTICS 


]4  August  1D74 


MEMORANDUM  FOR  The  Assistant  Secretary  of  the  Army  (Installations 
and  Logistics) 

The  Assistant  Secretary  of  the  Navy  (Installations 
and  Logistics)  __ 

The  Assistant  Secretary  of  the  Air  Force  (Installations 
and  Logistics) 

The  Assistant  Secretary  of  tiie  Army  (Research  and 
Development) 

The  Assistant  Secretary  of  the  Navy  (Research  and 
Development) 

The  Assistant  Secretary  of  the  Air  Force  (Research 
and  Development) 

SUBJECT:  Trial  Use  of  Reliability  Improvement  Warranties  in  the 

Acquisition  Process  of  Electronic  Systems/Equipments  - 
ACTION  MEMORANDUM 

Reference:  (a)  ASI)(1&L)  Memo  to  Secretaries  of  the  Military  Departments 

dated  17  August  1973:  Subject:  Trial  Use  of  Warranties,  etc. 


As  part  of  the  Department  of  Defense's  efforts  to  reduce  costs  ami  improve 
operational  reliability  of  electronic  systems  and  equipments,  reference  (a) 
requested  that  a trial  application  of  warranties  (now  called  Reliability 
Improvement  Warranties  (RIW))  he  utilized  in  the  acquisition  process  Lo 
help  determine  the  scope  and  benefits  that  RIWs  mav  have  for  the  Do;). 

The  objective  of  a RIW  is  to  motivate  and  provide  an  incentive  to  contrac- 
tors to  design  and  produce  equipment  which  will  have  Low  failure  rate.;  and 
low  repair  costs  during  f ield/opetat  icrnal  use.  This  rechnique  attempts, 
through  the  use  of  contracting  agreements  (which  I'xtenJ  for  several  years 
after  Government  acceptance  of  the  equipment)  to  provide  an  incentive 
repair  costs  in  order  to  maximize  their  profits.  Thus,  the  intent  of  the 
RIW  contracting  technique  is  to  realize  improved  operational  reliability 
and  maintainability  of  Dol)  systems  and  equipments  for  isicii  additional 
dollar  that  the  contractor  uses.  For  those  reasons,  a RIW  is  not  a main- 
tenance contract  and  therefore  should  not  be  used  ior  this  purposi'. 
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As  a result  of  reference  (a),  a Reliability  Improvement  Warranty  Committee 
was  established  to  prepare  a definite  OSD  policy  with  regard  to  the 
application  of  RIWs  in  the  procurement  process.  The  committee  member- 
includes  representatives  from  the  Office  of  the  Assistant  Secretary 
of  Defense  (Installations  and  Logistics),  the  Office  of  the  Director,-  Defense 
Research  and  Engineering  and  the  Military  Departments.  Valuable  inputs 
have  been  provided  by  each  committee  member  plus  contr ibutions  by 
representatives  from  the  Office  of  the  Assistant  Secretary  of  Defense 
(Comptroller)  and  the  Office  of  the  General  Counsel.  Mr.  Donald  F. 

Spencer  from  the  Oifice  of  the  Assistant  Secretary  of  Defense  (Installations 
and  Logistics)  has  functioned  as  the  Chairman  of  the  Committee.  The 
committee  completed  the  1'  IW  GvideFnes  on  12-  July  !q7L  Included  in 


the  Guidelines  arc  a KF.V  ueii.’i' 


scope,  trie  I\IW  application  criteria, 


the  special  funding  requirements,  the  essential  elements  in  a RIW  contract 
clause,  the  RIW  evaluation  approach,  and  the  potential  benefits  which  may 
result  from  the  use  of  a RIW.  Thus,  the  Guidelines,  enclosed  hereto, 
arc  available  for  immediate  use  on  a trial  basis  and  should  aid  in  determin- 
ing whether  potential  economic  and  reliability  benefits  do,  in  fact,  result. 
Therefore,  the  Military  Departments  arc  now  requested  to  undertake  a 
trial  use  of  RIWs  in  a number  of  electronic  system/equipment  programs. 
Those  programs  should  be.  ;.d<  ntmed  and  ttieir  planned  intended  use  of  a 
RIW  reported  to  the  Office  of  the  Assistant  Secretary  of  Defense  Ilk L) 

WI  (Attn:  Mr.  Donald  F.  Spencer)  which  will  continue  to  function  as  the 
OSD  coordinator  for  RIW  activity. 


To  realize  the  maximum  potential  from  the  use  of  RIWs,  it  is  important 
not  only  to  identify  the  good  results  but  also  to  identify  the  problem  areas 
so  that  the  latter  can  be  facto:  ed  in  and  corrected  in  the  Guidelines. 
Particular  attention  sh<>'  ’d  b>  given  to  the  collection  of  data  so  that 
accurate  evaluation  can  v-i_  ,-fO-lc  of  each  program.  It  is  requested  that 
quarterlv  status  repor*:  to-  .sub milted  on  the  candidate  systems. 


O • -I . W'-q — 

Hon.  Arthur  I.  Mendolia 
Assistant  Secretary  of  Defense 
(Installations  and  Logistics) 


Hon.  Malcolm  R.  Currie  ^ lo' 

Director,  Defense  Research 
and  Engineering 


Enclosure: 

RIW  Guidelines 
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RE  1,1  AIMI  TTY  IMl'ROVFXI  KMT  V.'A!  RANTY  GUIDE!, IKES 
DK FI  NTT  ION  AN  1 > SCOFF 

One  of  the  most  significant  items  of  continuing  concern  to  the  Department 

of  Defense  is  the  need  for  improved  reliability  and  maintainability--  ojr 
weapon  systems'  equipment. 

A contractual  technique  used  in  the  commercial  environment  and  currently 
being  utilized  on  a trial  basis  within  the  DoD  as  a means  of  implementing 
such  improvements  is  the  Reliability  Improvement  Warranty,  or  R1W  (also 
previously  known  as  a "Failure  Free"  or  "Standard"  Warranty).  1 he 
objective  of  a RTW  is  to  motivate  and  provide  an  incentive  to  conti  actors  to 
design  and  produce  equipment  which  will  have  a low  failure  rate  as  well  as 
low  repair  costs,  after  failure  due  to  ficld/opt  rational  use.  Furthermore, 
this  technique  attempts,  through  the  use  of  contractual  agreements  (v.l  re  t'r 
period  o;  terfoi  matirc  extends  over  several  years),  to  provide  an  incentive 
for  contractors  to  improve  lire  reliability  of  their  equipment  and  to  reduce, 
repair  costs  during  the  period  of  warranty  coverage  in  order  »o  maximize 
the  i r pt  of  it  s . 

It  should  be  noted  that  a R 1 W is  not  a maintenance  contract  and  docs  not 
require  that  the  contractor  provide  routine  periodic  upkeep,  regulation:., 
adjusting,  cleaning  or  e ther  norma'  upkeep.  A R1W  also  does  not  cover 

1 _/  "id  ainta  ir.abil  ii  y ''  r-.Vrs  to  a design  feature  of  a system,  r.ul  system, 
cquipn. t n*  os  component  which  connotes  that  the  item  is  * i.b  - -at  t.. 
beii.e  it  na’.'.d  aim  mamt.ii  .•<!  in  ar  e.;tal>)  ir.l.c-d  environment,  end.  r 
d all ; u d i ■ i « nditinn*  a : d w : ; : ■ n ; • t t i : .i e a m!  c o 1 r • v • . , ■ 


1 


components  of  a warranted  item  which  arc  expected  to  need  replacement 
under  normal  use  during  the  term  of  the  warranty  (.such  as  filters,  light 
bulbs,  etc).  Such  items  may  be  provided  for  by  separate  provisions  in 
the  contract  consistent  with  current  laws  and  regulations,  but  they  shall 
not  be  included  in  the  R1V/  provision.  In  general,  a RIW  will  provide  fur 
the  repair  or  replacement  of  failed  units  as  well  as  agreed  to  no  cost 
engineering  changes  and  the  calibration,  adjustment  and  testing  associated 
therewith. 

c The  Armed  Services  Procurement  Regulation  (ASPR)  states  that  a 

/ warranty  clause  gives  the  Government  a contractual  right  to  assert 

/ claims  regarding  the  deficiency  of  supplies  or  services  furnished,  not- 
/ 

t withstanding  any  other  contractual  provisions  pertaining  to  acceptance  h) 

\ the  Government.  Such  a clause  allows  the  Government  additional  time  uftei 
acceptance  of  these  supplies  or  services  in  which  to  asst.  il  a i ighi  to 
correction  of  the  deficiencies  or  defects,  re-per  forma-ice,  an  ecjui.ubli 
adjustment  in  the  contract  price,  or  other  remedies.  This  additional 

i 

period  of  time  may  begin  at  the  time  of  delivery,  or  at  the  occurrence  of 
-.'S' r i a specified  event,  and  may  run  for  a given  number  of  days  or  months  or 

I ‘ ■"  _ 

until  occurrence  of  another  specified  event.  The  intent  of  such  a clause 


is  "buyer  protec' ion"  from  non- conforming,  materials  or  poo:  wo: 
The  R1W  goes  beyond  this  conventional  concept  of  warranty.  1 


: wor  hr.; < n s i . i p. 


L 
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The  essence  of  the  Hr."  philosophy  is  that  during  the  period  of  the 

warranty  coverage,  for  a fixed  price,  contractors  will  be  encouraged 

0 

to  improve  the  reliability  and  to  reduce  the  repair  costs  of  the  equipment 
through  the  mechanism  of  "no-cost"  (to  the  Government)  Engineering  Cha-r.ge 
Proposals  (ECPs),  These  ECPs  shall  be  consistent  with  Government 
procedures  to  preserve  Configuration  Control.  Cnee  a fixed  price  i9 
established  for  the  warranty,  the  actual  profit  realized  by  the  contractor 
is  dependent  upon  the  equipment's  reliability  and  maintainability  in  service 
use,  plus  any  improvements  that  he  can  make  in  its  reliability  and  main- 
tainability so  as  to  keep  the  number  and  cost  of  repairs  as  low  as  possible. 

A BIW  results  in  the  contractor  focusing  his  attention  on  his  reliability 
and  maintainability  efforts,  since  through  6uch  a program  he  car,  obtain 
greater  profit.  Thus,  a R1\V  becomes  a contracting  technique  by  which 
the  Government  derives  the  benefits  of  improved  reliability  and  main- 
tainability for  each  additional  dollar  that  the  contractor  earns.  The  above 
features  therefore  distinguish  a BIW  from  the  conventional  warranties 
described  ir  ACPK. 

The  BIW  concept  may  be  introduced  a*  any  point  during  the  acquisition 
cycle.  Normally,  the  maximum  benefit  can  be  expected  by  including  such 
a BIW  contract  provision  at  the  time  of  award  of  the  initial  production 
coni.:  act  for  the  system/1  ■quipmiont.  For  new  equipment,  it  will  ^gener  ally 
be  appropriate  for  the  Government  to  indicate  to  prospective  contractor  r 
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early  in  the  development  cycle  that  it  plans  to  consider  such  a warranty 
provision  /or  inclusion  in  the  contract  at  the  time  of  initial  production 
approval.  , By  ao  doing,  contractors  will  be  motivated  to  ensure  that  their 
equipment's  reliability  and  maintainability  are  giver,  appropriate  attention 
at  the  time  it  is  initially  designed,  since  this  could  affect  its  subsequent 
repair  or  replacement  costs. 

The  greatest  value  of  a R11Y  contract  provision  is  expected  to  be  realized 
In  the  initial  years  of  the  equipment's  fi<-ld  deployment.  Thus,  after  the 
equipment's  reliability  and  maintainability  have  been  satisfactorily  demonstrated 
through  field  use,  the  Cover nment  .may  then  assess  the  cost  effectiveness  of  the 
RIW  to  determine  whether  to  continue  or  to  eliminate  such  warranty  coverage. 

It  should  be  emphasized  that  the  terms  and  commitments  required  of  the 
contractor,  particul arly  f or  the  initial  warranty,  should  result  in  a reasonable 
balance  between  tils  risks  and  the  degree  of  incentive  needed  to  achieve  the 
primary  goal  of  system  availability.  The  size  and  scone  of  the  initial  commitmer. 
should  be  determined  in  consideration  of  the  uncertainties  in  future  support 
costs  and  the  risks  involved  to  both  contractor  and  government.  This  period 
of  warranty  coverage  generally  will  continue  for  at  least  three  years. 

lihUA  liliny  LM  PRO  YEMEN  T WAR  R AN  TY  (RIW) 

A Reliability  Improvement  V»arranty  is  defined  as  a provision  in  cither 
a fixed  price  acquisition,  nr  fi\:-d  pvico  equipment  overhaul  contract  in 
which: 


7(, 


if. 


(*)  the' contr  actor  is  provided  with  a monetary  incentive,  throughout 
the  period  of  the  warranty,  to  improve  the  production  design  and  engineering 

9 

of  the  equipment  so  as  to  enhanc.c  the  field/operational  reliability  and  main- 
tainability of  the  s y sie rr./ecuipment;  and 

(b)  the  contractor  agrees  that,  during  a specified  or  measured  period 
of  use,  he  will  repair  or  replace  (within  a specified  turnaround  time)  all 
equipment  that  fails  (subject  to  specified  exclusions  if  applicable). 

A fixed  price  for  the  RIW  coverage  should  be  agreed  upon  d-rir.g  negotiation 
of  the  acquisition  contract  or  equipment  overhaul  contract.  The  warranty 
should  also  be  established  as  a separate  contract  line  item.  In  the  case 
of  formally  advertised  contracts,  the  terms  of  the  warranty  and  a separately 
priced  contract  line  item  must  be  provided  for  in  the  Invitation  for  Bids 
PE  LI  ABIE ITY  IMPK  OVEN!  ENT  WAR P ANTY  (PIW)  APPL1 C AT  JON  CRITERIA 
Decisions  for  RIW  application  should  be  made  as  early  as  possible  in  the 
acquisition  cycle.  The  contractor  should  be  inforined  early  in  the  design 
phase  that  there  will  be  wananiy  requirements  so  that  he  car.  make  important 
trade-offs.  It  is  notc-d  that  the  equipment  need  not  meet  all  the  criteria  shown 
below  in  order  to  apply  a P1W.  Pathcr,  at  this  point  in  time  the  Government 
should  pick  logical  candidates  which  meet  several  or  many  of  the  criteria 
90  that  further  assessment  can  be  made  of  the  value  of  this  technique. 

The  following  criteria  may  be  used  for  selecting  equipment  as  potential 
candidates  for  Reliability  Improv*  uu-ni  Warranty  coverage.  These  criteria 
may  \>e  used  lor  systems,  subsystems,  units,  subunits,  or  even  modules. 


a.  A v arrmiy  can  be  obtained  at  a price  rtiinvns'iralc  wit!  ihr  core 
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b.  Moderate  to  high  initial  support  costs  are  involved. 

c.  The  equipment  is  readily  transportable  to  permit  return  to  the 

9 

vendor '•  plant  or , alternatively,  -the  equipment  is  one  for  which  a contractor 
car  provide  for  field  service. 

d.  The  equipment  is  generally  self-contained,  is  generally  immune 
from  failures  induced  by  outside  units,  and  has  readily  identifiable  failure 
characteristics. 

e.  The  e^-lpment  application  in  terms  cf  expected  operating  time  and 
the  use  environment  are  known. 

f.  The  equipment  is  succcptiblc  to  being  contracted  for  on  a fixed 
price  type  basis. 

g.  The  contract  can  be  structured  to  provide  a warranty  period  of 
several  years.  This  should  allow  the  contractor  sufficient  time  to  identify 
and  analyze  failures  in  order  to  permit  reliability  and  maintainability 
improvements . 

h.  The  equipment  has  a potential  for  both  reliability  grcv.th  and 

reduction  in  repair  costs. 

i.  "Potential  contractors  indicate  a cooperative  attitude  toward 
acceptance  of  a RIV>"  provision  and  evaluation  of  its  effectiveness. 

j.  A sufficient  quantity  of  the  equipment  is  to  be  procured  to  make  the 

:«  \ 

PIW  cost-effective . • ..  _ . 

k.  The  equipment  is  of  a configuration  that  discourages  unauthorized  , 
field  repair,  p)  < f rably  sealed  and  capable  of  «.  ordaining  an  FI! apsod  1 im_ 
Indicator  (ETi*  <t  some  oi  !•*.•!  me  vis  us  ape  < ntrol. 
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l.  There  it;  a reasonable  decree  of  assurance  that  there  will  be  a 

* 

high  utilization  of  the  equipment. 

m.  The  equipment  is  one  tliat  permits  the  contractor  to  effect  no-cost 
ECPs  subsequent  to  the  Government's  approval. 

n.  Failure  data  and  the  intended  operational  use  data  can  be  furnished 
the  contractor  for  the  proposed  contractual  period  and  updated  periodically 
during  the  term  of  the  contract. 

FUNDING  OF  RFLI A1  UNITY  IMPROVEMENT  WARD  ANTI  K-S 
In  the  past,  different  points  of  view  have  been  expressed  regarding  the 
funding  of  RlWs.  Lack  of  clear  guidance  in  this  area  lias  caused  difficulties 
in  the  use  of  this  contractual  technique.  In  order  to  provide  clarification 
regarding  the  types  of  funds  to  be  used  for  procurements  inc or por aiing  a RIY’ 
the  funding  policy  guidelines  have  been  authorized  for  use  by  OASD 

(Comptroller)  and  Office  of  Assistant  General  C ou.is  el  ( F.M ) . These  funding, 
guidelines  should  permit  the-more  effective  utilization  of  RlY/s. 

a.  KIY/s  shall  be  funded  from  the  same  appr opr iation  as  t!:e  acquisitio: 
or  overhaul  warranted  (i.c.,  the  warranty  siiall  be  paid  from  the  procur emcn 
operation  and  maintenance,  or  ItDTaE  appropriation  of  the  service  or  agency 
concerned  depending  on  from  which  of  the  said  appropriations  the  acquisition 
o)  overhaul  is  funded).  The  RIW  cost  is  part  of  the  fixed  price  contract,  and 
payment  to  the  warrantor  foi  ihe  RIW  portion  shall  not  be  made  in  a manm  i 
different  than  payment  under  the  remaining  portion  of  the  contract,  except 
that,  payment  I'm  lh<-  RIW  mav  be  delayed  until  delivery  or  r cl  inqu  i ; bn  a.  ; i >f 
con 1 1 o)  of  t h t item  by  1 \ < w . 1 1 r an ‘ u r , 
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b.  In  or  dot  to  maintain  t la:  important  d i .'.t  inc  t ion  between  a R1W  and 


service  c 


ontract  (oveiing  normal,  periodic  maintenance,  tire  following 


requirements  must  be  satisfied: 

(i)  The  KIW  shall  be  included  in  a fixed  price  contract  for  the 

I 

acquisition  or  overhaul  of  an  item  or  items. 

- I 

(ii)  rl  he  warranty  period  on  each  item  shall  begin  after  manufacture 

I 

or  overhaul,  upon  delivery  or  relinquishment  of  control  of  the  item  by  the 
warrantor. 

(iii)  The  R1\V  shall  require  the  warrantor  to  repair  or  replace  the 
warranted  item  upon  failure. 

(iv)  The  KIW  shall  not  include  requirements  for  the  warrantor  to 

I 

provide  normal  upkeep,  cleaning,  adjusting,  regulating  or  other  periodic 

I 

maintenance  which  would  be  required  without  respect  to  failure. 

(v)  The  KIW  shall  exclude  components  of  the  warranted  item  wHcli  u 
normal  circumstances  will  require  i emplacement  before  the  expiration  of  the 

I 

warranty  (such  as  filters,  light  bulbs,  etc.).  Such  item:,  u,:ij  lu  provided 
for  by  separate  provisions  in  the  contract  consistent  with  curre  it  laws  and 

I 

regulations,  but  they  shall  not  be  included  in  the  K1V.  provision. 

I 

ESSENTIAL  E 1 LMLXTS  IN  RiW  Cl.Al  ° L 
Because  RIW  provisions  must  be  tailored  to  the  item  selected,  a standard 


KIW  clause  is  not  feasible.  However,  the  following  is  a lisi  of  liic.sc  essentia.' 

* . I 

elements  which  normally  should  be  considered  for  inclusion  in  such  a.rj.  ns.-: 


— 

• ..  1.  .STATEMENT  OP  C ( »NT  I<  ACT  W ARK  A N’T  Y 

<«  i 

a.  TERM  . State  length  of  time  warranty  will  be  in  effect.  This  should 
cover  usage  (operating  hour  s)arV<l/or  calendar  time  (generally  three  years 
or  longer). 

b.  OllJECTIVE/SCOPE:  State  the  primary  objective  of  the  warranty, 

i.  e.  , to  motivate  the  contractor  to  design  and  produce  equipment  which  is  mori 
reliable  and  less  cosily  to  repair  than  at  present.  If  there  is  to  be  a 
specified  reliability  requirement,  this  should  be  clearly  set  forth  in  the 
contract. 

c.  F.M  l.U'l  K:  State  what  constitutes  a failure  which  will  require  the 

contractor  to  repair  or  replace  a failed  item,  at  his  option,  at  no  change 

' in  contract  price. 

d.  EXCLUSIONS;  Stale  what  conditions  (e.g.  items  lost  or  damaged  due 
to  fire,  explosion,  etc.)  and  actions  associated  with  repairs  (e.g.  packing 
shipping,  etc.)  arc  specifically  excluder  under  the  warranty. 

<• . SHIPPING  COSTS:  State  if  contractor  or  Government  pays  for  expen. a 

of  returning  failed  units  to  contractor. 

f.  PRICE:  Indicate  a separate  price  for  warranty  coverage  and  for  the 
basic  unit  procured  in  order  to  make  it  possible  to  determine  the  cost  to 
the  Government  of  the  R ! Y,r . . 

!1.  CONTR  ACTOR  OPEIGATION 


a.  WAR!’  AM  V MAR 

; : i NGS.  R 

cquire  contractor  to 

cause 

pro::  i imu 

! Jl 

of  pe»  lin  t information 

on  surface 

of  unit,  showing,  that 

item 

i r,  v r r nt 

cd. 

warranty  period,  action' 

- In  tub'  i f 

unit  fails  during  war 

r.inty  ] 

1 * * • ’ t.  1 c . 
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b TURNAROUND  TIME:  State  turnaround  time  required  by  the  contract 

and  contractual  adjustments  or  other  considerations,  as  appropriate,  to  be  , 

exacted  if  the  contractor  exceeds  the  number  of  days  so  specified.  A contract 
turnaround  time  should  be  defined  as  qate  unit  }s  received  by  contractor  for 
repair,  to  date  unit  ts  repaired  and  shipped  by  contractor  to  Government. 

c.  RECORDS:  Require  contractor  to  maintain  records  by  serial  number 

for  each  unit  under  warranty  and  to  make  such  records  available  to  the  Government 
upon  request, 

in . GOVERNMENT  OBLIGATION: 

a.  CONTAINERS:  Indicate  whether  or  not  the  Government  will  supply  special 

containers  for  reshipment  of  units  to  and  from  their  destinations  for  the  life  of 

th  e warranty. 

b.  NO-COST  MODI  FIG  AT  IONS:  State  procedures  for  submittal  of  contractor 

initiated  no-cost  ECPs  designed  to  improve  the  unit's  reliability /maintainability. 
Th-  contractor  should  be  advised  that  such  ECPs  will  be  subject  to  the  Government’ 

approval. 

IV . M. ISC  EEL  AN  E OU S 

a.  INSPECTION:  State  the  extent  of  both  Government  and  contractor  inspectio 
to  he  required. 

b.  DISPOSITION:  State  that  each  unit  returned,  that  is  not  considered  rennr 

av  , shall  be  disposed  of  by  the  contractor  as  directed  by  the  Administrating 

a :i-g  Officer  (ACO).  Also,  indicate  the  manner  of  disposition  of  the  unused 
f the  i .Trinity  for  «o\  •u.it  subjected  to  an  e scluded  failure  or  that,  unon 
\CO,  is  dc«l.ir.<i  list. 


1 1 . c 
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c.  N'OT IFICATION:  Indi rate,  the  requircm.r.t  for  both  the  contractor  and 

# 

the  Government  to  notify  each  other,  within  a specified  time,  of  any  deficiency 
discovered  in  a unit. 

d.  - UNVERIFIED  FAILURES:  State  whether  or  not  the  contractor  will  be 

compensated  for  the  cost  of  testing  items  returned  to  him  under  the  warranty 
for  which  no  discrepancy  is  found. 


ment  is  authorized  to  make  adjustments  to  units  under  warranty. 

V.  DATA  REQUIREMENTS 

WARRANTY  DATA:  The  contractor  will  be  required  to  establish  and 

maintain  a data  system  capable  of  providing  a repair  record  of  each  unit, 
analysis  of  unit  failure,  number  of  items  returned,  turnaround  and  pipeline 
time  of  unit  returned,  remaining  warranty  coverage,  etc. 

k.  GOVERNMENT  DEVELOPED  DATA.  The  Government  shall  be  required 
tc-  provide  in  a timely  manner,  available  Government  generated  operation  a.nd 
maintenance  data  generated  on  the  equipment. 

DETERMINATION  OF  COST  EFFECTIVENESS  OF  USE  OF  A RELIABILITY 

IM PR OVEME NT  WARRANTY 

The  benefits  to  be  derived  from  use  of  a RIW  provision  should  be  related  to 
the  cost  thereof  to  the  Government  as  well  as  system  reliability  and  availability. 
In  the  case  of  new  systems  and  equipment  entering  the  Government  inventory 
which  are  not  similar  to  existing  equipment,  the  Government  will  have  no  direct 


12 


exoerience  with  such  items  for  a baseline  cost.  Therefore,  to  compute  benefits 
versus  warranty  cost,  in  the  above  instance,  may  require  judgment  on  the  part 
of  the  Government. 

In  general,  a cost  analysis  should  be  performed  for  each  proposed  warranty 
application,  upon  receipt  of  the  contractor's  proposal,  in  order  to  determine 
whether  or  not  use  of  a RIW  would  be  cost  effective.  Such  an  analysis  should 
investigate  the  relative  cost  of  the  RIW  and  non  R1W  situations  (including  ECPs) 
arid  examine  the  cost  of  varying  time  periods.  The  use  of  a RIW  provision  will 
generally  involve  additional  costs  over  the  acquisition  cost.  These  costs  must 
be  compared  with  "in  house"  Government  costs  to  perform  repairs  and  make 
equivalent  reliability  improvements. 

The  decision  to  accept  or  reject  a RIW  provision  must,  therefore,  be 
based  in  part  on  the  support  costs  the  Government  would  incur  if  the  equipment 
were  purchased  without  a RIW.  The  Government  support  organization  would 
have  to  provide  a cost  estimate  to  do  the  things  that  the  contractor  would  do 
under  the  RIV>’. 


In  order  to  make  an  accept /r eject  decision  as  to  use  of  a RIW  provision, 
the  actual  price  proposed  by  the  contractor  for  the  RIW  must  be  known.  It  is 
therefore  important  that  the  contractor  be  required  to  separately  price  the  RIW 
provision  sot  hat  a comparison  can  be  m ide  with  the  Government  estimate. 

R ) : ! iIAUlEIT  Y let  PROV  RMF.XT  WARRANTY  EVALUATION  APPROACH 


vie 


In  evaluating  th<  effectiveness  of  the  F.JW 
vpoirit,  if  is  essentia]  that  .iccur jlc  data  be 
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approach  lion1  a cost  and  perforin.  ' 
path,  red  on  field  reliability  and 


utilization  plus  maintenance  actions  and  that  the  contractor  be  cooperative  in 
reporting  actions  taken  under  the  warranty.  Both  the  Government  and  the 
contractor  must  establish  and  maintain  a data  system  capable  of  providing 
Information  relative  to  warranted  equipment  so  that  a suitable  evaluation  can  be 

made. 

It  would  be  most  desirable  to  determine  how  effective  the  RIW  approach 

has  been  when  compared  with  identical  or  similar  equipment  whose  repair 

was  accomplished  by  a Government  repair  facility  or  by  separate  contract; 

howe ver , ' thi s may  not  be  possible  in  many  instances.  Thus,  when  an  item 

under  warranty  is  being  produced  for  the  first  time  or,  when  there  is  no 

I . 

Identical  or  similar  non-warr anted  equipment  available  for  comparison,  it 
will  be  necessary  to  compute  what  it  would  have  cost  the  Government  repair 
facility  to  do  the  job  if  there  had  bcci^no  warranty  provision  in  the  contract, 
based  on  the  failure  rates  actually  experienced,  time  to  repair,  number  of 
spares  required,  etc.  This  method  of  comparing  estimated  Government  repair 
facility  costs  with  the  contract  price  paid  for  the  warranty  is  one  of  tnc  few 
methods  available  to  evaluate  the  relative  cost  of  the  warranty  approach  where 
.a  control  group  is  not  present.  , 

In  assessing  whether  or  not  the  RIW  approach  used  in  a given  procurement 
has  increased  reliability,  case  of  maintenance,  and  the  service  life  of  the 
equipment  from  both  an  acquisition  and  a repair  and  overhaul  bas^is,  we  must 
ensure  that  sufficient  usage  data  is  available  undei  the  contract  to  enable  a 
pi  oper  analysis  to  be  made.  In  oilier  words,  a significant  portion  of  the  contract 
warranty  i: m % , Lm  t*»iii]>b*led,  vitl*  i rspci  t to  * >.pnn • ! ed  hours, 


so  that  ; definite 
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trend  has  been  established.  This  is  especially  importer.*,  since  there  is 

0 

a possibility  that  benefits  commensurate  with  the  price  paid  for  the  warranty 
may  not  materialise  because  of  a'reduction  in  the  use  of  the  equipment  under 

that  contracted  for  in  the  warranty  provisions. 

Factors  to  consider  in  evaluating  P,I\V  results  (pertaining  mainly  to  equip- 
ment for  which  we  have  operational  experience)  in  order  to  make  a determinate: 
, tr,  c--—  tc  the  Government  due  to  use  of  a RIW  prevision  are 

as  follows: 

a.  Number  of  operational  units  procured. 

1).  Price  of  basic  unit  as  well  as  price  paid  for  warranty  coverage. 

C.  Warranty  period  in  months. 

d.  Operating  hours  used  pur  month,  as  well  as  total  program  operating 
hours  involved. 

e.  The  planning  MTBF  that  the  warranty  was  based  upon,  as  well  as  the 
number  of  returns  planned  on  during  the  warranty  period. 

f.  In  the  case  of  new  equipment  buys,  the  amount  of  savings  estimated  in 
initial  Government  support  costs  by  precluding  the  need  for  such  support  items 
as  test  and  support  equipment,  training  of  Government  personnel  and  techmca. 
manuals.  However,  in  determining  the  savings  involved,  care  should  be  tikcr 

that  if  the  Government  expects  to  assume  support  after  the  warranty  expires, 

: * « 

"start  up"  costs  should  be  -ncluded. 

g.  Government  recurr  ing  support  costs,  s ich  as  tl.c  cost  of  warranty 

administration.  For  •••.ample,  tna  and  s'-ippl}  personnel  must  be 
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trained  in  handling  and  shipping  warranted  units  so  as  not  to  void  the 


terms  of  the  warranty.  Furthermore,  the  special  data  requirements 


of  warranty  clauses  will  also  require  administrative  action, 


Ji.  Number  of  spare  units  required  due  to  excessive  contractor  turn- 


around time,  arid  cost  thereof  to  the  Government. 


i.  Comparison  of  cost  of  organic  repair  (processing  through  Government 


depot  repair  facility)  of  unwarranted  items  with  repair  costs  for  same 


items  under  warranty. 


j.  Comparison  between  contract  price  for  R1W  coverage  (for  the*  hours  of 


operation  contracted  for  under  the  warranty  provisions),  with  the  rep.  i; 


expense  based  on  acquiring  the  same  number  of  operating  hours  from  at 


unwarranted  unit. 


k.  Comparison  of  MTJ»F,  turnaround  and  pipeline  time  of  the  warrant. 


items  with  that  for  unwarranted  similar  items  and  the  effect  thereof  on 


availability  of  equipment  to  the  Government 


1.  The  extent  to  which  any  improvement  in  the  MTI1F,  turnaround  anu 


pipeline  time  of  the  warranted  equipment  may  he  attributed  to  the  RF 


contract  provisions. 


If  there  is  a reduction  in  the  use  of  the  equipment  under  that  cor 


t r . . . • 


for  in  the  warranty  provisions,  whether  or  net  this  has  resulted  in  bc-nefits 


not  being  commensurate  with  the  price  paid  for  warranty  cover 


n.  Any  rcdo<  lion  in  co:  t assoc  luted  with  relaxation  of  configr.i  a- ion 


on  I to),  qu.l'iy  a >■  I me  a. id  i .dial. ill  y tints 


othi  ,u_  i 'Hoc,  i ;_i;!  :•:  > i knt_raxi  me  at  iqits 

A principal  motivation  for  HIW  is  to  provide  an  incentive  lor  the  manu- 
facturer  to  be  responsible  /or  the  field  reliability  (rather  than  laboratory 
or  bench  reliability)  of  his  equipment  and  encourage  him  to  modify  the 
equipment  as  needed  to  achieve  reliability  improvements. 

In  the  absence  of  such  an  incentive  the  government  has  traditionally 
relied  on  a number  of  specifications  and  standards  for  configuration 
management,  quality  assurance,  reliability  demonstration  and  parts 
and  fabrication  procedures  in  an  attempt  to  enforce  the  production  of 


reliable  and  maintainable  equipment.  For  each  procurement  for  which 
a warranty  is  planned,  a review  should  be  made  to  insure  that  proccdui c: 


and  specifications  are  not  applied  in  such  a manner  as  to  increase  inhci  ei 
costs  or  to  reduce:  contractor  opportunities  to  make  cost  saving:  . 

potkn*'  i ial  r.r.xrrrrs  n i o Mjjf \v.  or  k fl  i a ft  i . r rv_r a.i-fc  > v r myi 

v/ari:an  nrs 

Many  potential  benefits  to  both  the  Government  ana  the  contractor  may 
result  from  the  use  of  RIU’  provisions.  Some  of  these  benefits  are  as 


f t *1 ) o w s : 


Pi EN  F FITS  TO  GOV  Is  KM  FN  T 


a.  Incentives  and  responsibility  for  field  reliability  are  assigned  to  »h 


coni  i a.  c I or 


b.  Greater  emphasis  is  placed  on  the  life  cycle  co  t appro. u.!.. 

c . The  contractor  is  responsible  to  keep  all  units  up  to  the  sail 


c on  f );•  ii : a I in:. 
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d.  There  is  an  increased  incentive  for  the  contractor  to  introduce 

« . 

de s i gn /pr odut  lion  changes  that  will  increase  the  M i BF  of  the  equipment 
and  result  in  reliability  growth. 

e.  An  incentive  for  reduction  in  repair  costs  is  provided,  since  any 

reduction  in  labor  hours  or  materials  used  in  repairing  equipment  will 
increase  the  contractor's  profits.  , 

f.  Minimal  initial  support  investment  is  required  by  the  Government, 
since  the  contractor  is  to  provide  repair  services  during  the  warranty 
per  ioci . 

g.  lilW  usage  may  reduce  requirements  for  skilled  military  maintena 
anti  support  manpower. 

BEN  V KIT  S TO  C C iNT  RAC  TOR 

a.  Increased  profit  potential  when  field  MTBF  is  improved  above  pro 
ht.se . 

b.  Multi-year  guaranteed  business. 

c.  The  contractor  becomes  more  famili.tr  with  the  operational  rcli.  b 
and  i 'u  a in  a inabil  it  y characteristics  ofiiis  equipment,  which  should  help  , 
in  obtaining  follow-on  contracts. 

CONCLUSION 

Jn  conclusion,  a Reliability  Improvement  Warranty  is  a procurement 

l 

approach  which,  when  properly  applied,  can  reduce  the  Government's  lif 

* • t 

cycle  costs.  Inherent  in  the  R ] \V  concept  is  the  contractor's  motivation 
continuous]}  reduce  rcpaii  or  replacement  life  iycle  costs  tfro-t  N i «•*»  1 


effort  applied  beyond  hardware  acceptance.  Due  to  the  continuous  stress 

! I 

by  tl>e  contractor  on  decreasing  failure  rates,  the  Government  benefits 

1 

I 

through  better  equipment  availability. 


? . 
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MEMORANDUM  FOR  A 

/v 


ir; l ant  Secretaries  of  flic  Milita  ry  Departments 
istant  Secretaries  of  the  Military  Department ;; 


SUBJECT:  Reliability  Improvement  Warranty  (KIW)  Guidelines 

References:  (a)  ASD(IPt  J ,)  Memorandum  to  Secretaries  of  the  Mill* a ry 
Departments,  dated  1-1  August  1974,  regarding,  Reliability 
Improvement  Warranty  (R1W)  Guidelines. 

(1>)  Council  of  Defense  and  Space  Industry  Associations 
(CODSIA)  Fetter,  dated  18  July  1979,  regarding  KIW 's. 


The  purpose  of  this  memorandum  is  to  clarify  and*  expand  on  DoD's  curin 
RIW  Guidelines.  Your  support  in  continuing  to  sec  that  reliability  incen- 
tives are  properly  applied  to  contracts  is  'essential  to  reduce  support  eo: 
and  improve  field  reliability.  This  is  especially  important  in  light  of  the 
recent  concerns  expressed  by  industry  that  RIW  's  may  he  ineppropri ..t  1; 
applied  so  as  to  pose  undue  risk  on  contractors  (reference  b,  enclosure  . 
the  issues  raised  therein  will  be  investigated  by  a recently  formed 
tri -Service  working  group). 

I ' 

Wc  wish  to  re -emphasise  that  the  principal  objective  in  applying  RIW 's  i; 
to  inccntivizc  contractors  to  design  and  produce  reliable  equipment. 
Imposition  of  unreasonable  terms  and  risk  on  contractors  will  not  serve 
tlii:;  objective. 

Tl>e  RIW  objectives  can  be  best  achieved  under  a fixed  price  contractual 
agreement.  Other  incentive  approaches  for  improving  equipment  reli- 
ability should  be  utilized  when  <'ipjd.icati.on  of  a RIW  would  result  in  undue 
risk.  A recently  established  "Tri-.Serviue  Reliability  and  Support  Incen- 
tives Group"  will  in  the  next  four  months  investigate  other  contract  ini  ci 
live  techniques  and  develop  guidelines  for  these  concepts . Your  support 
of  this  {'.roup's  efforts  is  requested. 
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(JR  D) 

( w L) 


.‘ill 


At  1 • cl  :n<  nt  1 


Two  major  criteria  for  the  application  oJ  .'MW1:;  ar.-  : (1)  ,lu‘  field 
reliability,  costs  to  support  the  ecpiipmcn! , and  p*.t  nib  l fur  .bilil.y 

growth  will  be  reasonably  predictable  at  (lie  linn  lie  i n'iii  f c.-'--  I price 
bid  is;  made.,  and  (?.)  the  term:;  of  tin.  It IV/  be  tailor  c-'  so  that  li.e  rewards 
and  risks  to  both  industry  and  i in  j;OVcj  nmciil  ar,  : cci-plal.,:  «■.  I ■ 
criteria  are  discussed  in  enclosure  1. 

The  above  .criteria  should  be  disseminated  as:  a cla  ri  M i alion  < nd  expan- 
sion to  the  current  1UW  guideline's.  Procuring  age  re  to.-;  should  be 
instructed  to  apply  the  two  preceding  criteria.  For  each  R1W  application 
an  independent  analysis  should  be.  performed  to  del . ' mine  thul  com  rail  or 
bids  arc  reasonable  and  that  there  is  a proper  bah  m ■ m tween  pub  m al 
rewards  and  risks. 

Proper  application  of  the  above  guidelines  will  coni  rebut e to  the  with  r 
rise  of  warranties  on  a sound  basis.. 


/ 

toting  /• . - ; ; : .Tut.  y if  1 1 • ■ j t !.  si 

( Ins  ' . . M ...  1. 1 o;jy  :j.,u  J,..  e , s t ) c a ) 
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Enclosures 


APPLICATION  C)F  lllW'.s 


MAJOK  CRITERIA  for  application  of  RIW's  arc: 

* • 

1.  Field  reliability,  costs  to  support  the  equipment,  and  potential 
for  reliability  growth  will  be  reasonably  predictable  at  the  time  the  firm 
fixed  price  bid  is  made. 


2.  Terms  Of  the  RIW  be  tailored  so  that  the  rewards  and  risks  to 
both  industry  and  the  government  arc  acceptable. 

For  RIW  application  to  have  maximum  affect,  contractors  should  be 
told  early  in  development  that  a warranty  is  anticipated.  It  is  desirable 
to  elicit  a warranty  quote  during  the  competitive  phase  in  order  to  get  a 
reasonable  price.  This  raises  the  problem  that  the  quote  may  be  solicited 
prior  to  the  completion  of  development  testing  and  with  associated 
uncertainties.  As  a gcnciutl  rule,  the  price  quote  should  be  solicited  as 
late  in  the  program  as  possible,  under  competition,  and  consistent  with 
the  needs  for  test  data  associated  with  each  program. 

There  are  a number  of  criteria  which  should  be  satisfied  for  a pro- 
gram to  be  selected  for  RIW  application,  examples  of  which  are  contained 
in  the  current  RJW  guidelines.  A. major  criteria  which  should  be  emphasized 
is  reasonable  risk  to  industry  as  well  as  to  the  government.  Such  is 
significantly  influenced;  (1)  by  whether  the  equipment  is  evolutionary,  (2) 
by  the  availability -of  test  data  (at  the  time  of  bid)  on  which  to  base  cost 
and  reliability  estimates,  and  (3)  by  the  ability  of  the  government  to 
provide  the  contractors  with  reasonable  projections  of  mission,  environ- 
ment, and  expected  utilization. 


Application  of  RIW's  does  not  have  to  be  limited  to  procurements  that 
arc  merely  a repackaging  of  previously  fielded  equipment.  It  can  be 
applied  to  any  new  equipment,  even  if  the  design  utilizes  new  technology 
and  there  is  ho  previous  field  experience.  What  is  important  is  that 
adequate  development  time  and  testing  be  scheduled  to  support  reasonable 
cost  and  reliability  estimates,  at  the  time  the  firm  fixed  price  bid  is  made. 

For  any  RIW  application,  considerable  latitude  exists  in  tailoring  the 
terms  and  conditions  to  the  uncertainties.  For  example,  the  reliability 
guarantee  can  be  tailored;  turn-around  lime  requirements  can  be  varied; 
exclusions  can  be  adjusted  to  fit  the  situation;  and  the  initial  commitment 
can  be  limited  to  the  initial  production  buy.  In  general,  the  greater  the 
uncertainties  the  less  stringent  would  be  the  warranty  terms.  In  no  case, 
however,  should  terms  be  tailored  to  such  an  extent  that  the  RJW  objective 
of  improved  field  reliability  and  reduced  support  costs  arc  no  longer, 
inccntivizcd. 


Fn*  '.'.sure  1 


APPENDIX  B 


CODS! A REPORT 


Brig/Gen.  Dewey  K.  K.  Lowe 
Director  of  Procurement  Policy, 
DCS/Systems  & Logistics,  Hq . USAF 


"RELIABILITY  IMPROVEMENT  WARRANTY  - KEY  ISSUES" 


April  23,  1976 


l . 'i  i Mint;  hi-'  I* ; u A'l  i rj : 

A.  W!irii  Should  It  I W Ur  Applied? 

In  . mJ(!  riiss  l ilf*.  l Ik*  quf.i  i mi  of  "wheu"  k I W should  I '0  ;ip[>  1 1 r cl  , cons  i di  ■ i .i  t 1 o 
must  at  the  snr.r  i iinr  In  given  to  "how"  It  should  be  .applied,  and  aim) 
to  | ie  > t i iu-  n t b.i  c kg  i o uiul  nil  .1  h i s t o 1 1 r a 1 i at.  t or  s relating  to  re  liability, 
from  tlir  l.iboi  i lory  and  I ie  Id  linage  vantage  point!!.  i und.iment  a 1 s of 
contractor  and  government  i ink  must  also  be  addressed. 

o Hack  gi  oiind 

'Industry  is  keenly  aware  of,  and  quite  sympathetic  with,  the  UTAI' 
mid  lui  iiapiov.  d field  iili  ibility  and  feels  that  one  route  to  the 
achievement  ol  that  goal  may  be  a properly  applied  K1W  program.  The 
current  change  in  emphasis  iron)  "performance-  at  almost  any  cost"  to 
a de  lire  for  a propel’  balance  of  performance,  unit  production  cost, 
reliability,  maintainability,  and  availability  is  also  well  recognized 
and  applauded.  h.  achieving  this  balanced  emphasis  on  reliability  and 
J owe  i op.  luting  costs  tin  has  fell  the  necessity  to  provide  an 

curly  incenlivi  which  will  help  insure  propel’  emphasis  on  le.s  r "petal  it. 
cost  (i.e.,  reliability  and  tna  i nt  a i nab  i 1 i t y ) dining,  the  critical  design 
and  development  pc. i tod . It  is  during  this  period  that  the  great,  st 
impact  on  event  ua  I tic  id  reliability  will  lie  realized.  The  problem  > ■ 
high  operating  < .e.t  and  associated  low  availability  resulting  I row  p.  1 
field  reliability  and  maintainability  is  not  new. 


While  it  i:.  true  that  performance  ha:;  been  the  overriding,  fu.t.n 
in  lorn,  i yv.ti , I he  rttl  iab  i ) i ty  quest  Jon  w;is  not  entirely  i p.iioi  e<l . lie 

in  i I i 1 1 appro...  b was  to  spec  i ly  a required  H'lbV  in  tin:  procure  v nt  i 

l„il.  i.tnty  t . si  r.  in  i benign  environment  were  carried  out  to  dc\>  1 .-l  •!  < 

that  tin  s.  p.  i i 1 i eel  reliability  had  been  achieved . I .a  t er  an  alt.  ,pi  w ■ 

made  to  i. in. ul. ite  the-  ambient  environment  during,  these  laboratory  t(  ' 
and  finally,  reliability  g.rowth  testing,  was  instituted  during,  tl  I el  t 
i , ■ r y re-  liability  test  cycle.  That  these  t cclui  i epi.  , did  not  ac  h i eve  ' 
de-.  it  id  results  in  the  field  is  evidenced  by  the  < hart  "it  |>ag.e  111.  i'll  • 
chart  plots  the  reliability  achieved  in  the  field  against  the  see  :t  - 
icl  i . . 1 1 i l i t y lot  i on  diilei.nl  tactical  radars  in  at.  many  vari.-t  i.  • 
ajrei.ift  . All  of  the  various  previously  discussed  technique:  I r . 
r e 1 i . . b i I i l y in  the  laboi  at  or  y are  repres.  ul  e .1  in  this  sample.  T . ■ 
tin  1 .ilior.il  < • t y tests  ap|)rn;<  i mu  t ed  l be  spec  i f i cat  ions  be  I ora  > e it. 

til  full  'll  p rodui  I i on  Well  mule  . 11  it.,  therefore,  ohv  i me  t I m * 'I 

t et  I .n  i | ii"  s did  not  solve  the  real  p lob  I cm  of  reliability  in  the  I . i ' •'  • 

ii  r.  Is  lit  Ii*  doubt  that  tin  USAT  faces  a real  plobleu;  i ‘ < t 

of  o',',  i 1 iug  tbi';  trend  of  low  field  reliability  and  ra  • . , u 1 I . . i , ' . ■ i > 1 ■ 

i . j ..  i t 'eg  ad  et . an  e cost  is  not  found  . Ac.  or  el  i trg,  l c>  Ii  i g . 1 1 

ej  1 1 i I i i i . . t I ).  1 1 1 .air.  s , i i 1 t i ■ e ir  y i ■ . i r s -go  (>  0 a.  i>  f the  II  So  1 bud  g t w 

e>.|n  . I.  .1  on  in. a an.,  nt  in  new  equipment  and  SOT  on  O.SM  and  !■■.'.  i 

30'  i s piat  oa  i nv.  tisi-irt  and  70'  on  I'.'.M  and  pay.  Unless  thi  • i • 

is  revel  I,  tl.  • iinsi'quiiit  es  to  tin:  ItSAK , industry,  and  the  n.i* 
b. - i tub  . I set  iniiit. 


1I.< 

d<  v 1 1 | 


It;  \t  ib  - . i i e to  inti  erdiu  . 
t e y i I e*  of  a p r ogr  mi  and 


t In  K1W  rant  opt 
l In  i eby  pt'ov  i di 


quite  , ill'. 

the  i t)i  i til  ie 
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X 


NL 


l;U 

/ ! 

i 

A'' 


Indn  r 
l><  l 'l / 


not 


*/ 


I lif-  coni  i ni  lo  runs  id.  r 
t out  1 1 1 j;  vi  I h unit  pi  - » u I Ion  > • 
.Mail-lab!  e . t.i »l)>] A • . m l I , 

re  lulu  cm  1 to  tin-  t i ! . i ! 
by  iihirli  thi  oh  jt-(  t i . ■ i • *ci  or 

f 

t>  K.  .up  It 

T.  '-.i  r..-i  I.. 


i/fy.  lliii  LI  l ho  hardware  is  tested  in  an  op»  i 
it /*:  i t h t yp  i < a 1 ii|K  i at  ional  users,  and  in  .ill  pi 
’it1  ii,.,  i*t  rcl  i.ihi  1 i ty  (the  basis  for  a goo  il  KIV^ 


• ...lit  1 N 


li.t  ah  U ". 


i i-spft  i.illy  tme  in  today's  techno]  oplcal  ei^j*  i rtinm  -ni  where 


V IV  i/,  id  ili./j...  lit  I If  oilier  of  lilt  day.  ill  the  \J/F  i n i . • : . arena 
lor  i /■:  pie  , -.a  h.ivt  , in  tin  la.  t IS  years,  pi  >,  pi  f i *,•.,»  la  rgj  ly 

tin  » /i . 'a  i ,1.  .-i.-f-'.  to  di  <rote  solid  stale  t e t h.iol  rfgy  ai>if  on  to  intf- 
pi.iWxd  i iimitiy.  Inti).  rated  circuits  themselv  havi-M  tip  i,d  1 y pone  t/ 
i i JT.u  loth  i I tuple  dev  i - to  m-.-dii",  stale-  j nt  ej'.ral  ion  , ai:.-i  n:i  to  / 


r-d  f,l  mu  yf 

if-'l  /,/•' 


/ 


lJ-ri'.t:  stall  integration.  Meanwhile  system  concepts  have,  chant 
ctili  -in}-,  1st  p.-ly  analog-,  interfaces  to  today's  reliaa  • on  dij 
J i n t e l r.iia  s . 

All  of  i’Ii  i s t eehnol  epical  advancoincnt  appears  to  he  moving  in 
l.lu  i ip, lit  diieetion  to  prently  improve  reliahility  ever  that  of  ( nliei 
generation  equipment  and  the  reliahility  predictors  *re  post  n I at  i up 
thi-;  to  1.  the  taff.  Caution  is  urped,  however,  si  net  in  the  past 
ill  i.di  lily  predict  ions  have  scld  i if  ever  matched  fold  ii  liability 
numbei  s,  evi  i where  similar  tech  1 opy  has  been  previously  I ii  lihd 
'Jin-  accuracy  of  (lie  prediction-,  is  even  more  quest  J onah  1 e when  tin 
t eehiiol  o)-,v  involved  has.  not  h d the  henefit  of  a valid  comparison 
between  act  n il  field  results  and  predict  ion. 

When  l In-  concept  of  reliability  growth  testing  was  conceived  (i.e., 
the  I e >.  I Ii:  test  iiy.  pi  i i I .o)  diy ) il  was  advanced  as;  a means  of  artivinp 

at  a high  lev.  I of  re  I i a I i I i ty  during  the  development  cycle;  a level 
whifh  would  tt  itmlate  into  field  reliability  with  little  or  no  dc- 
grada!  ion.  Actual  i ielil  experience  has  not  borne  ou*t  these  opt  i in  ill  ii 
i ■ p<-f  t , it  ion-  . 


One  t a i I ical  radar,  for  example,  was  subjected  i;o  tin-  type  of  test  in;, 
out  lined  . 1 1 * o v t fot  a tot  .i  1 of  8 m 8 U hours  in  the  factory.  Under  this 
ti  . t J 1 1 j -.  whiili  involved  some  .Vi  systems,  an  MTIlF  of  iltol  hours  \.ms  achievid 
.)•  f)i<  9 Of'  confidence  level.  It  should  he  noted  t hall  these  tests  wi  re 
cen-lti.  led  in  a 11 1 1 .-  tlTlJ  781  environment. 
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/ 


/ 


3 - 


/ 


>r 


St’VtTii  1 yi-jrii  Inter , tlu’sr  same  i ndaru  exhibited  n reliability 
of  only  26  MKIII’d-  (Mo  m II  i , Itt  Hour  he  tween  Failure)  on  one-  type  of 
aircraft  and  J3  I!!  ilbl  on  another  type  of  aircraft  according  to  ll.SAK 
bt)S  1 data  collection  system.  This  represents  a degradation  of  about, 
,/t  to  1 over  the  laboratory  test  results  which  il  lust  rate,*  l lu.‘  uncer- 
tainty involved  in  predicting  field  MTBF  based  on  laboratory  re-dolts 


Tliis 
f:  rowt  b l i 


/ 

h slu >n  1 d not  be  taken  as  a condem/at  ion  of  • 
i phi  l.i-.nphv  however,  since  this  exhibit  I 

i el  i u!>  i I 1 1 y about  3 times  that  of  similar  syj^fems  which  had 
through  this  expel i ence . / 

/ 

3hi':  example  is  not  an  islonted  e/Tse.  Another  coni' 
t. ietii.il  i id  . i which  lec  eivcd  much  emphasis  on  rollahil 
dev  I epment  , l in  1 nd  i tig  re  1 i ah  i 1 i t y>'  growt  h testing,  ■>  i 
a dcciad.il  ion  of  about  A to  1 f v-oin  lah  t c>  field  <H  ' 


lie  ic 
,i  f 1 1 
IIOl  ' 


1 1 


!'. 1 • 

1 1 noted  where 

xff’s 


elegi  ada  t i on 


/ 


h i gh 


at 


l 3 to 


I. 


h. 
i « in 


•d  . 


■ hi’uld  lie  tibvioti! 
I ifl  1 scale  development 
goal  based'  on  I aheu  .i^rvy 
is  not  a viable 


rt  lie)  c'fnrtC  that 
i not'd  i njf".  1 v it 
t est  i ligand  pi  I ' ' 


^ i 


at 


I ■ ratlin 


I o 


' / 


• ( in  ui-uty  dt'Volc 

at  i hen  equipment 
in  a di  f f c i ent  ,-t  y*pi 
< at  )y  alter  cool/lip, , 
etc.,  in  .uciV'a  way 
e<|uipment  Py6\n  one  £.'Viu 


i cm  iient  and  apprec  i all  1 y afleet  tin 


t ak 


pred  i r j 


An  obvious  , li  v-  mid  he  t lit'  use  of  66-1  data 

pat  ion  system  in  ti  in  port  aircraft  and  using  it  to 

reliability  of  that  sour  system  in  a fighter  aircraft, 
stated  that  the  6 1 > — 1 ct.it  a in  itself  is  subject  to  some 
hi  ciir.il  i in.  a me  of  field  reliability  since  its  valid!'  >- ■ <- 

aic  of  tided  by  such  I ad  or:;  as  retest  OKs,  consee|tn.-rf;d  fa  i 1 ut  • , 
lac  I of  pnoel  failure  mode  cl.it  a , and  opcrator-anel-mu  l a',  ci  mi  • i.ihie.l 
lailiires  (osull  ) np,  from  I lie  inexperience  of  organic  field  maid  nan 
teams,  and/eii  operator-users. 


In  addle 
i mil  i p l , i ( i 

use  oi  KIW  by  the  military. 


ing  1 1 ic-  general 
a fact  t hat  very 


It 


ub j oc t 
little 
appear 


of  risks  f nve  1 ved/A.' 1 1 h 
actual  expi  rience  ■ \ i i 
c that  only  two  IISAK  pi  ) i 


n; 


ll.l' 


provided  some  limited  experience. 


it  would  appear  that  with  1 lie  scant  amount  of  KIW  expc  i.  e .it  bin 
I l would  In  well  to  )iroceed  slowly  ancf  cautiously  on  KIW  uni  dal  i < ■ i 
chi  t a base  i s ava  i 1 .ih  1 c . 
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.X 


concerns,  wpvTd  prefer 
li^c'y  understands  this  pre- 

- --  ’ • rrJr 

) C A 


In  summary.  The  USAF  rootivabed  by  v 
an  early  industr'y  coir.-fi t merit-  tp'  RIW 

^pTTch  a commitment,  as  exempli!  _ 
fcy  several  recent  signif ic.rht  procut/'Vunt  implementations.  Happily.',*//' 
however,  wc  believe  this -USAF/' industry  dichotomy  can  be  resolved_.de  the 
satisfaction  of  both  partied  by  ,/C  contractual  technique  of  progresisivef 
application  ofTlIW.  This  technique  would  vary  somewhat  depending  on 
|jie  type  of  program  involved./ 

' / 

8 General  Approach  and  Rationale 


J 


In  sitaations  involving  the  design/d<  v«  ’ 
an  RIW  cost  goal  (similar  to  a uni!  prod'.  • 
set  early.  A meaningful  or  positive  ii 
later  achievement  of  that  goal.  D<  in  - 
volved, the  incentive  would  b i.  :.if  - 
the  program.  In  any  event,  t:.e 
must  include  expanded  devoid  i 
testing  with  adequate  t i • and  1 
is  particularly  important  tha' 
post  of  adequate  compon>-u:  ' 
contract  line  item  win  i . 

be  made  early  and  on  tin  : i . a 1 


cycle, 
il  ! be 
I i o t ne 
program  in- 
i t i . i pal.ron  in 
production  phases 
• i.Td  rel  iability 
h this  testing.  It 
' i prepared  to  allow  the 
r.  n t (as  a separate 
tint  design  tradeoffs  can 
data. 


/ 


/ 


>■ 


A properly  appl 
reliability;  (1)  J 
phase  of  a pro;,.’ 
and  achievable  . 


d K 


tract 


id 


(2)  after  the  e i 
for  cent inm  ' re . 


' ive  two  favorable  impacts  on 
design,  development  and  test 
i pi  . idc  tile  opportunity  for  a practical 
'•ii l r.ictor  under  a CP1F  form  of  con- 


into  tiie  hardware  i 


1 1 1 ni  a mail  i ! it  y 

i operational,  RIW  should  provide  an  incentive 
v improvement.  This  latter  improvement  is 


achieved  tb-ou,  . p--rly  applied  firm  fixed  price  type  RIW  contract,* 


( i . c . , aft 


or  1 


id  . 1 id.ited  test  results  are  in  hand)  under  which 


the  contractor  i t balance  the  cost  of  continued  repairs  against  the 
cost  of  i iT  i iTiity  improvement  changes.  In  order  to  reduce  his 
total  cost  under  the  RIW  it  is  anticipated  that  the.  contractor  will 
indeed  r he  field  changes  which  '..’ill  incrementally  result  in  improved 
rel  i.ibi  lily. 


/ 


Of  these  two  impacts  on  reliability,  undoubtedly  the.  greatest  po- 
tential impact  is  achieved  during  the  design,  development,  and  test 
phase  of  a program.  l'or  this  reason  the  USAF  has,  in  some  recent  pro- 
curements, requested  FFF  RIW  options  at  a program  milestone  prior  to 
full  scale  development  (i'SD)  of  hardware. 


s 


/ 


On  the  other  hand,  industry  considers  the  risk  associated  with  the 
premature  (i.t pro  FSD  i%  operational  test)  commitment  to  RIW  on  a FFP 
basis  to  be  unduly  high.  This  is  particularly  true  where  now  develop- 
ment is  involved,  however,  repackaging  or  use  in  a different  application 
may  render  historical  reliability  data /invalid. 

/ 


/ 


/ 


/ 


/ 
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A resolution  of  thin  dichotomy  would  he  to  establish  RIW  goals 
only  during  the  development,  program  tied  to  a realistic  incentive  ii 
the  goals  are  mot.  The  development  acquisition  cycle  should  include 
a test  of  production  type  hardware  in  an  operational  environment, 
during  which  test  field  reliability  would  be  measured.  The  incentive 
should  be  based  on  how  well  these  lest  results  match  the  development 
goals  and  the  FFi‘  RIW  quote  would  also  be  based  on  the  results  of  litis 


Achievement  of  the  developmental  RTW  goal  would  be  measured  against 
actual  performance  of  pilot  production  hardware  (or  preproduction  pro- 
totype hardware  If  the  task  is  considered  to  be  an  expansion/extent,  ion 
of  flit  development  phase)  in  the  operational  use  environment. 

The  FF1’  R1W  would  he  quoted  at  the  termination  of  the  opera  L i one  1 
t est,  per  rod  and  would  ul  ilize  contractor-acquired  and  analyzed  field 
•fai_Jj^rtr'd«!  a ai-prfnpaiated  during  this  test.  Incentive  payment  would 
also  be,  iTa.'.ed dSn/how  well  the  development  goal  matched  the  ac  tual  pet 
forijwmf'o  in  the  "ope/ at  iyuM^Ktest  . _.I  t is  believed  that  a dcvclopmin* 

■program-  st  r u gi^u  r ijif  1 [ ned  above  would  reduce  tlie  risk  to  a mnn.ig' 

a M fy  i eve  1 


only  production  of  additional  quant  (tie 


of  hardwase  wh  i c l^drrTTf"  been  previously  fielded  may  be  amenable  to  l-TT 
Kill  w/(.boiLi— riie  test  phase  outlined  above.  This  application  docs  not 
yl  y<^r  opt  i ini  im  tit  ili<:al  ion  of  RIW  however  si  net*. -it  comes  too  late  in 
^rfv  to  inf.iuence  reliability  dm  injtthc  {jjjjM^i'opnietiL /design  phase. 
fhi  1 y the  rysults  ol  the  rol  iabi  1 it. y j*W!>wth  phase  of  RIW  could  he  liali. 

o Spin  i f Le  Approaches  *'  ■f' 


Ii  any  event  , the  detailed  mcehaiiie'b  of  applying  t hi  pt  T'  ..id  K1W 
plan  will  vary  somewhat  depending  on  the  type  oi  program  -itivol  veil . 

Three  types  oi  propi  .mis  will  he  conf;  i'dered  for^msT^  detailed  disiio:  ion 

1.  1’. 1 ra  1 I e I IVve  Uipmont  1’ r<  gyam 

A.  Ihiral lei  development  program  is  defined  as  one  in  which  two 
or  more  competing  suppliers  are  carried  through  full  scale  development 
and  at  least  up  in  the  production  decision  point  (DSARC  ill). 

in  such  a program,  it  would  he  assumed  that  the  USAF,  in  vising 
KIW,  would  be  interested  not  only  in  the  lowest  possible.  ORM  costs 
but  also  in  achievement  of  the  lowest  l.lfe  Cycle  Cost  (l.CC)  . U1W,  then, 
is  a means  of  bringing,  more  realism  to  the  costing  of  the  oper.it  ion.il 
phase  of  the  program's  life  cycle. 


In  the  parallel  development  program,  goals  for  total  Life  by  1< 

Cost  would  be  set  at  tlie  beginning  of  the  program.  The  coirnet  1 1 oi  r 
would  then  l>e  encouraged  to  trade  off  unit  production  cost  goals  . i >•  • I n •. t 


- O - 


support  cost  goals  Including  an  RIW  goal  (repair  cost)  in  order  to  arrive 
at  the  lowest  LCC.  Competition  will  insure  that  the  RIW  and  unit  pro- 
duction cost  goals  are  optimized  for  USAF  requirements.  The  development: 
phase  would  then  be  expanded  to  include  field  tests  of  all  competitors 
hardware  using  either  preproduction  prototypes  or  pilot  production 
hardware  built  for  this  purpose.  In  any  event,  the  hardware  used  in 
these  tests  would  be  built  to  production  drawings  and  with  production 
tooling.  The  tests  would  be  conducted  in  an  actual  operational  environment 
and  using  operational  type  personnel.  The  results  of  those  tests  would 
assure  the  USAF  of  the  realism  of  the  competitor's  reliability  claims 
and  would  at  the  same  time  reduce  the  risk  associated  with  the  FFP  RIW 
quote  for  industry.  No  incentive  is  more  powerful  at  this  stage  than 
the  desire  on  the  part  of  the  competitors  to  win  the  production  award. 

The  USAF  would  then  obtain  more  realistic  (i.e.,  contingency-free)  FFP 
RIW  quotes  from  the  competitors,  and  would  buy  production  hardware  with 
RIW  from  the  supplier  offering  the  lowest  LCC. 

Using  the  above  technique,  the  risk  associated  with  FFP  RIW  would 
be  reduced  to  a manageable  level  for  industry  while  at  the  same  time, 
the  USAF  Would  be  assured  by  the  competition  of  a reliable  design  with 
the  lowest  practical  RIW  cost.  The  use  of  parallel  development  is 
highly  recommended  wherever  possible. 

Although  this  technique  requires  a larger  cash  outlay  initially, 
it  would  no  doubt  result  in  the  lowest  life  cycle  cost  in  the  long  run. 

It  Is  recognized,  however,  that  the  initial  outlay  of  lacge  develop- 
ment funds  is  often  viewed  with  a jaundiced  eye.  by  RDT&K  fund  custodians, 
Congress  and  others  in  tiie  approval  cycle.  Nevertheless  this  outlay, 
in  our  judgment,  must  be  regarded,  not  as  out-of-pocket  expense,  but 
rather  as  investment  in  Lhe  future,  with  gains  to  be.  realized  and  measured 
in  terms  of  enhanced  equipment  availability  and  lowered  O&M  costs. 

2.  Competitive  Single  Development  Program 

The  competitive  single  development  program  is  defined  as  one  in 
which  competition  exists  only  through  the  early  stages  but  not  to  full 
scale  development.  Because  of  the  difficulty  in  obtaining  the  large 
outlay  of  front  end  money  associated  with  parallel  development,  this 
is  the  type  of  program  most  frequently  encountered  in  major  weapons 
system  programs. 

With  the  competitive  single  development  progran,  RIW  goals  would 
be  set  early  and  would  emphasize  the  importance  of  reliability  and 
Life  Cycle  Cost  during  the  critical  design  and  development  phase.  Tn 
this  type  program,  the  realism  of  these  goals  would  be  insured  by 
applying  a significant  monetary  incentive  (not  penalty)  to  the  achieve- 
ment of  the  goal. 

As  in  the  case  of  parallel  development,  preprcxluct  ion  prototypes 
built  to  production  drawings  and  tooling  or  pilot  production  articles 
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would  be  subjected  to  the  field  reliability  test  described  previously. 
Ag.i  in  the  field  test  would  be  carried  out  in  an  operational  environment 
using  military  personnel. 

The  FFP  RIW  quote  would  utilize  the  operational  IfTBF  determined 
by  the  above  test  results.  Using  the  same  test  results,  the  RIW 
incentive  payment  would  he  based  on  the  relationship  between  the  goal 
established  early  in  the  program  and  the  FFP  RIW  established  above. 

With  this  technique,  the  USAF  desire  to  introduce  the  RIW  con- 
cept early  enough  to  influence  the  design  would  be  satisfied,  while 
at  the  same  time,  industry's  risk  would  be  reduced  to  a manageable 

level. 

3 . Competitive  Production  Program 

Let  us  consider  two  instances  of  a competitive  production  program: 

(a)  In  the  first  instance  it  is  defined  as  a competitive  procure- 
ment of  additional  quantities  of  an  article  already  in  production 

and  already  fielded. 

(b)  The  second  definition  of  a competitive  production  program 

is  one  in  which  there  is  a multi-source  competition  for  the  production 
of  an  article  developed  by  one  firm  but  not  yet  developed  into  opera- 
tional use.  We  do  not  recommend  the  application  of  RIW  to  either  of 
these  programs  for  a number  of  reasons,  the  most  significant  of  which 
are: 

1. )  In  the  first  case  the  potential  for  reliability  growth 

would  be  limited  and  configuration  control  management 
would  offset  savings,  and,  in  the  second  cited  instance, 

2. )  Complex  hardware,  while  lending  itself  to  RIW  by  the 

developer  does  not  provide  adequate  data  to  the  competition 
to  constitute  a reasonable  risk. 

4 . Definition  of  "Povc 1 opment " fr o m a Technology  Viewpoint 

For  the  purpose  of  RIW,  "development"  is  simply  defined  as  any 
program  resulting  in  hardware  sufficiently  different  in  torn,  fit 
and  function  from  previously  dove  loped /deployed  hardware  as  to  require 
a formal  design  and/or  environmental  qualification  tent  program  prior 
to  the  device  becoming  operational. 


This  definition  then  applies  not 
advanced  technology  and  concepts,  but 


only  to  hardware  involving  new 
could  also  encompass  the  following: 


(a) 


Redesigns  of  existing  hardware 
(i.o.,  change  from  vacuum  Lube 

cuitiy  to  integrated  circuiorv 


to  modernize  the  circuitry 
or  discrete  component  dr- 
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(b)  Mechanical  repackaging  to  change  the  form  factor  for  a new 
application. 

B.  Options 

The  FFP  RIW  option  is  a firm  commitment,  and  should  be  quoted 
only  when  the  MTBF/RIW  Cost  is  "reasonably  predictable"  as  previously 
described.  On  programs  involving  development  this  occurs  only  after 
reliability  data  has  been  accumulated  from  operational  tests  and  analysed 
by  the  contractor. 

1.  Selective  Exorcise 


Two  definitions  of  "selective  exercise"  have  been  considered. 

The  preferable  definition  is  one  in  which  the  seller  is  asked  to  quote 
FFP  RIW  options  for  successive  FY  buys  of  equipment  after  completion 
of  the  operational  tests  previously  discussed.  Industry  has  no  ob- 
jection to  use  of  such  options  provided  that,  in  consideration  of 
technical  and  economic  factors,  the  price  for  the  options  is  subject 
to  redetermination  and  adjustment  at  successive  periods  to  be  set 
forth  in  the  contract. 

The  second  definition  of  "selective  exercise"  involves  the  case 
where  the  buyer  is  permitted  to  apply  RIW  selectively  to  portions 
of  the  equipment  under  procurement.  This  represents  a situation  which 
is  unsatisfactory  to  industry  since: 

(a)  It  presupposes  commitment  prior  to  the  availability  of  field 
MTBF  data,  and 

(b)  It  may  permit  the  buyer  to  select  only  the  low  reliability 
portions  of  the  equipment  for  the  RIW.  Thus,  while  the  equipment 

as  a whole  may  exhibit  quite  satisfactory  reliability,  the  supplier 
is  saddled  with  maintenance  cost  of  the  less  reliable  portion.  It 
would  also  seem  that  this  would  be  undesirable  from  a government  view- 
point because  of  the  elimination  of  hardware  items  whose  field  reliability 
could  be  improved  through  RIW. 


2.  Exercise  Restrictions 


As  outlined  above,  options  should  not 
liability  data  is  available.  The  exercise 
strlcted  to  purchase  of  RIW  for  successive 
ware  only. 


be  required  until  field  ro- 
of options  should  be  re- 
FY  buys  of  production  hard- 


C . How  Long  a Warranty 


The  warranty  period  should  extend  for 
time  being  dependent  on  the  type  of  product 
The  period  must  be  long  enough  to  allow  the 
d ita  bar"  •diich  will  permit  (tie  practicable 


several  years,  the  exact 
involved  and  its  application, 
development  of  a valid  field 
trade  off  between  cost  of 
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design  changes  and  cost  of  repairs.  This  is  the  key  to  the  "I"  (improve- 
ment) in  RIW.  Only  through  failure  analysis  and  possible  redesign  can 
improvements  be  made.  The  actual  warranty  length  will  depend  on  the 
usage  factor,  storage  time,  expected  failure  rate,  maintenance  concept, 

etc. 

D.  Termination  of  Warranty 

The  most  economical  approach  for  the  L’SAF  would  be  to  renew  the 
warranty  prior  to  the  expiration  of  the  initial  warranty  period.  Ne- 
gotiation of  the  warranty  renewal  terms  must  be  started  prior  the  last 
year  of  the  initial  warranty  period.  This  approach  would: 

1.  Reduce  the  heavy  salary  and  pension  commitment  by  USAF  for 
support  personnel 

2.  Minimize  the  need  to  purchase  organic  maintenance  training 
programs,  maintenance  handbooks,  intermediate  and  depot  level 
test  equipment,  etc. 

3.  Insure  continued  maintenance  by  highly  qualified,  well  trained 
and  experienced  contractor  personnel. 

A.  Eliminate  the  need  for  spare  parts  cataloging,  inventory  pipe- 
lines and  reduce  spare  LRU  (Line  Replacement  Unit)  requirements. 

5.  Have  a gradual  and  manageable  impact  on  present  organic  depot 
facilities  and  personnel  since  primarily  newer  systems  would 

have  RIV.T. 

If  the  RIU  program  is  terminated  and  organic  maintenance  imple- 
mented, then  provisions  should  be  made  in  the  initial  procurement  for 
the  orderly  phasing- in  of  USAF  maintenance. 
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' X1l  KTW  CONTRACTING  BASTS: 

A.  Type  of  Contract 

To  provide  the  flexibility  needed  to  procure  the  various  DoD  re- 
quirements, ASPR  ( 3 — A 0 1 ) has  established  a wide  selection  of  contract 
types.  At  one  extreme  is  the  firm  fixed  price  type  which  is  used  when 
there  are  reasonably  definite  design  or  specification  requirements  and 
the  costs  can  reasonably  be  determined  and  the  contractor  can  there- 
fore accept  full  cost  responsibility.  At  the  other  extreme  is  the  cost 
plus  fixed  fee  type  which  is  used  when  the  uncertainties  are  of  such 
a magnitude  that  costs  cannot  be  estimated  with  sufficient  reasonable- 
ness to  ensure  an  acceptable  risk  to  the  buyer  and  seller.  In  this 
case,  the  fee  rather  than  price  is  fixed  and  the  contractor's  cost 
responsibility  is  minimized.  ASPR  (3-401)  further  states  that  when 
the  risk  is  minimal  or  can  be  predicted  with  an  acceptable  degree  of 
certainty,  a firm  fixed  price  contract  is  preferred.  However,  as  the 
uncertainties  become  more  significant,  other  fixed  price  or  cost  type 
contracts  should  be  used  to  avoid  placing  too  great  a risk  on  the  con- 
tractor. 

It  is  within  this  framework  that  we  must  look  for  the  appropriate 
contract  type  to  be  used  for  RIW  contracting  at  various  stages  of 
equipment  design  development,  production,  and  operational  deployment. 

1.  RDT&K  Design  Phase 

The  design  and  development  phase  of  any  program  which  involves  new 
technology  or  new  applications  of  existing  technology  carries  with  it 
a significant  amount  of  uncertainty.  It  has  usually  been  the  practice 
for  the  services  to  contract  for  this  phase  utilizing  a cost  reimbursable 
typo  of  contract  which  is  compatible  with  the  ASPR.  We  have  not  generally 
experienced,  nor  do  we  envision  that  a change  is  justifiable  in  the 
basic  method  of  contracting  for  research  and  development  with  the  ad- 
vent of  RIW.  In  fact  the  uncertainties  of  equipment  field  performance, 
namely  MT15F,  during  this  phase  mandates  the  use  of  cost  reimbursement 
contracts . 

2.  Production  Phase 

We  are  also  concerned  with  the  method  of  contracting  for  the 
next  phase  — Production.  At  this  phase,  without  an  RIW  requirement, 
the  design  and  specification  requirements  would  have  been  finalized 
through  adequate  testing  and  the  costs  of  production  could  be  reason- 
ably determined.  However,  the  imposition  of  RIW  on  a fixed-price  basis 
at  this  time  introduces  unknowns  of  considerable  magnitude.  There- 
fore the  use  of  a form  of  cost-reimbursement  contract  continues  to  be 
necessary  during  the  production  phase.  A fixed  price  RIW  contract,  in 
addition  to  being  contrary  to  ASTR  and  DoD  Directive  5000.1,  is  con- 
trary to  the  application  criteria  set  forth  in  Lhe  RIW  Guidelines. 

These  gei.''  ’ •'  n , among  other  things,  that  the  fir'd  reliability,  costs 
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fco  support  the  equipment,  and  potential  for  reliability  growth  will 
be  reasonably  predictable  at  the  time  the  firm  fixed  price  bid  is 
ihade.  Without  field  reliability  data,  the  contractor  cannot  reason- 
ably predict  either  the  costs  of  support  for  the  potential  span  of 
reliability  growth.  If  he  cannot  reasonably  predict  these  items,  the 
Rewards  and  risks  to  industry  and  the  government  cannot  be  balanced 
SO  that  they  are  acceptable  and  equitable  to  both. 

the  OASD  (I&L)  memorandum,  dated  16  September  1975  which  was 
ihtended  to  clarify  the  guidelines,  recognized  and  supported  this 
position;  however,  enclosure  I thereto  seems  to  take  an  opposite 
View.  This  enclosure  states  that  RIW  can  be  applied  to  any  new 
Equipment,  even  if  the  design  utilizes  new  technology  and  there  is 
ho  previous  experience.  It  implies  that  lack  of  actual  experience 
ean  be  overcome  if  there  is  adequate  laboratory  development  time 
and  testing.  But,  it  goes  on  to  note  that  considerable  latitude 
fexists  in  tailoring  the  terms  and  conditions  to  the  uncertainties. 

Some  examples  are:  (1)  the  reliability  guarantee  can  be  tailored, 

(2)  turnaround  time  can  be  varied,  (3)  exclusions  can  be  adjusted 
to  fit  the  situation,  and  (4)  the  initial  commitment  can  be  limited 
to  the.  initial  production  buy.  In  general,  the  greater  the  uncer- 
tainties, the  less  stringent  would  be  the  warranty  terms.  If  it  is 
conceded  that  this  depth  of  tailoring  is  necessary  due  to  uncertainties, 
a cost  type  contract  for  RIW  would  be  more  appropriate  and  we  offer 
the  following  alternative  for  your  consideration. 

The  design  and  development  cost  reimbursable  contract  would 
appropriately  contain  a RIW  goal  with  positive  incentives  to  mo- 
tivate the  contractor  to  apply  resources  to  the  area  of  equipment 
reliability.  This  should  be  followed  by  the  purchase  of  a limited 
number  of  production  units,  either  under  an  extension  of  the  develop- 
ment contract  or  an  initial  production  contract.  We  feel  that  a 
cost  reimbursable  type  contract  is  most  appropriate  because  it  is 
during  this  field-test-before  warranty  phase  that  the  contractor 
would  be  acquiring  field  operational  data  and  making  design  improve- 
ments to  enhance  reliability.  This  "bridging"  phase  is  essential 
because  historically  it  has  been  proven  that  even  the  most  stringent 
development  testing  in  a lab  environment  is  not  a conclusive  quanti- 
fication of  the  operational  field  environment , nor  can  reliable  and 
valid  extrapolations  be  made  from  the  former  to  the  latter.  In  this 
way  the  unacceptable  financial  risk  of  premature  cost  commitments, 
is  minimized  during  the  period  where  there  are  many  uncertainties, 
with  firm  RIW  pricing  to  follow  when  appropriate  data  and  experience 
have  been  completed. 

B.  Incentive  Structure 


DoD,  in  its  incentive  contracting  guide,  states  that  profit, 
generally,  is  the  basic  motivator  of  business;  and,  the  profit  motivator 
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- is  the  essence  of  incentive  contracting,  however,  industry  and  the 
government  have  had  both  good  and  bad  experiences  in  the  use  of  in- 
centives. The  unsuccessful  ones  can  be  attributed  to  complex  incen- 
tive structures  which  were  difficult  to  adiuinster  and  were  manipulated 
by  the  parties. 

In  spite  of  these  bad  experiences , we  believe  that  multiple  in- 
centive cost  reimbursable  contracts  - with  proper  weighting  between  cost 
incentives  and  demonstrated  ML1F  - can  motivate  contractors  to  make 
trade  offs  between  increased  design  costs  and  lower  support  costs  in 
favor  of  KTBF.  Properly  structured  incentiv  under  the  cost  type 
contract  can  achieve  the  same  results  as  earlv  fixed  price  RIW  con- 
tracts with  the  proper  balance  of  risk  between  the  contractor  and  the 
government . 

As  incremental  improvements  in  MTBF  are  more  difficult  to  achieve, 
a curvilinear  structure  would  theoretically  be  a more  appropriate  and 
motivational  form  of  incentive.  However,  to  date,  there  has  been 
little,  if  any,  use  of  the  curvilinear  incentive  structure  and,  there- 
fore, inadequate  experience  upon  which  to  recommend  it.  Rather,  we 
would  recommend  the  more  conventional  linear  structure  for  use  wiLh 
RIW. 

C.  REWARD /Pr.h'AhTY  RFT.ATK^SH IP 

The  RIW  clauses  which  we  have  observed  to  date  in  RFP  and  con- 
tracts are,  from  our  perspective,  using  penalties  rather  than  '-evards, 
to  motivate  the  contractor.  We  do  not  mean  to  imply  that  rewards  by 
definition  are  not  provided,  but  the  prcbubility  of  a contractor 
achieving  them  are  slim  particularly  if  the  penally/reward  curve  is 
skewed  toward  the  former. 

The  following  are  representative  examples  that  have  appeared  in 
recent  hardware  pro'curemcnts : 

1.  Failure  cause  exclusions  are  very  limited  and  the  contractor 
must  establish  by  "clear  and  convincing  evidence"  that  any 
of  the  exclusions  are  applicable.  Such  matters  as  improper 
installation,  operation  or  maintenance,  as  well  as  the  nor- 
mal range  of  events  covered  by  force  majeurc  are  not  covered. 
Further,  the  standard  of  proof  required  would  be  extremely 
difficult  for  the  contractor  to  meet  considering  the  fact 
that  the  equipment  will  have  been  operated  solely  under  the 
control  of  military  personnel. 

2.  Contractors  are  faced  with  accepting  turn-around  times  (TAT) 
of  15  to  20  days  for  complex  "black-boxes"  or  risk  being 
non-respons ive . Then,  if  they  miss  the  TAT,  they  are  assessed 
liquidated  damages  for  each  day  in  excess  of  the  specified 
limit . 


7 


- 14  - 


3. 


Basic  to  the  RIW  clause  Is  the  requirement  for  lli  contractor 
to  repair  or  replace  all  unit;;  that  fail  (excepJTfor  limited 
specific  failure  causes)  even  though  caused  by  Mzrvlcc  personnel 
Not  only  does  this  result  in  the  contractor  injprring  expense 
to  repair  but  it  also  directly  inf  lances  incj^tively)  the 
operational  KTBF  and  therefore  the  -associate<ypenalties . 


4. 


I 


itial  MTBF  with 
8 months  of 
tee  is  not  achieved, 


The  contractor  is  required  to  guarantee  an 
*n  escalating  MTBF  value  each  yd-ir  through 
warranty.  In  the  event  that  the  MTbF  guar 
consignment  units  are  to  be  suppVicd  at  n-i  cost  to  the 
government.  Delivery  of  these  yinits  is  subject  to  liquidised 
damages  of  a specified  percentage  of  unit  price  per  da 
• maximum  of  a specified  nig'/ percentage  of  the  unit 
This  penalty  is  usuallv  bn;Vd  upon  a short  deliver  quire- 
icen.t  both  for  in-pioductioa  and  out-of-production  .its. 

If  the  contractor  fails  achieve  the  guaranteed  MTBF  over 
the  life  of  warranty,  -hjC  consignment  units  become 
property  %f  the  governr’-e^t  at  no  additional  cost. 


the 


These  clauses  may  not  be  as  objectionable  to  a contractor  if 
field  operational  test  data  were  ava i lab  1 (Xm  which  to  base  his  price, 
however,  without  this  data  they  may  be  rx>M  likely  to  become  penalties. 
Once  again,  if  the  implementation  of  Kl\-!  My  fixed  price  contracting 
were  delayed  pending  availability  of  ficWl,  operational  test  data, 
the  probability  of  a more  equitable  hal  dice  between  reward  and  penalty 
would  be  greater  and  hence  more  accep  to  the  contractor. 


III. 


be  greater  and  hence  more  accepc^t^fc 
MTBF  KlT'UTR’iTr.T.T  * Jr 

K.  Should  the  Government  specify  a n 


pecify  a minimum  MTBF?  (point,  growth, 


or  at  all) 


In  considering  a contrrfetual  requirement  for  RIW,  the  anticipated 
MTBF  is  the-tdtey  ingredient  id  determining  the  selling  price  of  the  RIW. 

In  a competitive  procurement  therefore,  in  order  to  insure  that  all 
competitors  are  striving  for  the  same  reliability  target,  it  would 
6eem  desirable  that  the  government  specify  a minimally  acceptable  MTBF 
goal  together  with  a growth  range  (e.g.,  800-1000  hours).  It  is  recommended 
that  this  goal  be  set  as  described  in  the  section  of  this  report  dealing 
with  "Joint  DoD/Industry  Ombudsman".  Briefly,  the  government  would 
aet  a tentative  value  for  the  MTBF  goal  based  on  applicable  historical 


* Both  MTBF  (Mean  Time  Retween  Failures  in  operational  hours)  and 

MFHBF  (Mean  Flight  Hour  Between  Failure)  have  been  used  to  determine 
reliability.  We  are  referring  here  only  to  MTBF  because  it  is  common 
practice  to  operate  equipment  at  times  other  than  during  flight. 
Accordingly,  hours  in  flight  may  represent  only  a fraction  of  total 
operation  tire.  Further,  the  : ,t  tb.-d  of  accurately  computing  llTTiF 
trust  he  specified,  and  the  u ■■■>  of  running  t . • nut  era  should  be  a 

requirement  whenever  technically  feasible.  the  accuracy  of  any 
alternate  system  must  be  subject  to  contractor  approval. 
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data,  etc.,  and  release  this  to  the  competitors  prior  to  release  of  the 
RFP  for  their  comment  and  tuning.  The  RFP  MTBF  goal  would  then  re- 
flect this  value.  Inclusion  of  a growth  range  would  provide  flexi- 
bility to  the  competitors  in  doing  their  tradeoffs  of  unit  production 

cost  and  LCC. 

| 

Another  possible  reason  for  the  government  specifying  a MTBF  would 
be  for  guaranteed  MTBF  (CMTBF) . Industry  feels  that  the  imposition  of 
both  RIW  and  OMTBF  on  the  same  contract  places  the  contractor  in  double 
Jeopardy  and  greatly  multiplies  the  risks  involved.  Of  the  two  plans 
for  improvement  in  field  reliability,  the  RIW  is  by  far  the  most  acceptable 
to  industry.  In  no  event,  however,  should  both  plans  be  imposed  on  the 
same  contract. 

If  a CMTBF  is  to  he  used  in  lieu  of  a RIW,  it  is  recommended  that 
the  value  be  set  as  follows: 

B.  What  Kind  c-f  MTBF 

It  is  recommended  that  the  specified  MTBF  be  set  in  the  same  fashion 
as  described  previously  for  setting  the  RIW  price,  i.e.,  an  MTBF  goal 
6hould  be  sec  prior  to  the  desi gn/develonmcnt  stage.  Incentives  should 
be  applied  to  the  meeting  of  that  goal.  The  firm  GMTBF  value  should 
however  not  be  set  until  operational  type  tenting  has  been  performed 
on  equipment  similar  to  production  hardware;  and  the  final  GMTBF  value 
should  be  based  on  the  results  of  those  tests.  The  rationale  is  identical 
to  that  given  for  RIW  in  the  section  on  "Timing  of  RIW  Application". 

Although  the  operational  type  of  test  is  essential  to  the  •proper 
setting  of  the  GMTBF  value,  MIL-STD-781  reliability  growth  testing  should 
not  be  abandoned  since  it  is  an  essential  part  of  any  de  slopment  pro- 
gram aiming  at  a high  field  reliability.  As  noted  elscwl.  re  in  this 
report,  although  MIL-STD-781  test  results  have  not  been  directly  corre- 
latable  with  field  reliability,  they  have  proven  to  be  a means  of  weeding 
out  many  failure  modes  during  the  development  period,  and  therefore, 
funding  and  time  should  continue  to  be  supplied  for  these  tests. 

C . When  Shou Id  it  be  Applied?  Successive  Targets? 

Industry  feels  that  if  a GMTBF  is  to  be  used,  the  successive  target 
approach,  coupled  with  a high  degree  of  contractor  freedom  in  introducing 
design  changes  during  the  successive  measurement  periods,  is  the  most 
productive  one  for  both  industry  and  government. 

For  the  government,  it  provides  some  of  the  same  reliability  growth 
features  inherent  in  the  RIW  concept;  while  for  industry  it  provides 
a realistic  and  attainable  initial  target,  thus  permitting  time  to  dis- 
cover some  of  the  unknowns  involved  in  extensive  and  varied  field  use 
of  the  product.  At  the  same  time  the  achievement  of  a higher  final  MTBF 
va!u  will  result  because  f the  1 mini  r. liv.  • than  w.  uld  be  achi  ved 
if  a point  target  only  were  iuvolv  d. 
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D.  Joint  DoD/lndustry  Oivlu • Ismnn 

We  believe  that  a joint  DoD/lndustry  ombudsman  group,  although 
mutually  beneficial  in  some  situations,  c.g.,  policy  or  regulation  re- 
view, is  not  appropriate  for  the  task  of  "scrubbing  down"  MTBF  require- 
ments  in  the  solicitation. 

The  use  of  an  "independent  consultant"  (i.e.,  not  one  of  the 
competitors)  raises  questions  of  qualification,  competency,  and  what 
might  be  called  "respons-ibility  to  client"  if  the  consultant  were  to 
be  engaged  by  the  government.  Also,  it  must  be  recognized  that  such 
a consultant  assumed  no  risk  under  a contractually  binding  commitment. 
For  these  reasons,  we  recommend  against  the  use  of  such  a consultant. 

There  are  alternatives  current  available  to  the  services  which 
should  effectively  accomplish  the  same  end. 

For  example,  the  Department  of  Defense  Directive  4105.6?,  dated 
January  6,  1976  furnishes  a mechanism  for  reviewing  requirements  within 
DoD  and  for  utilization  of  industry  input  in  arriving  at  the  decision. 
Subparagraph  III.D.2.h(2)  provides  for  the  establishment  of  a Review 
Board  that,  "Shall  insure  that  specification  requirements  have  been 
thoroughly  examined  and  justified  for  the  purpose  of  eliminating  non- 
essential  or  unduly  restrictive  requirements  and  that  the  solicitation 
requirements  have  been  correlated  with  the  operational  needs." 

Subparagraph  ITI.C.2.h. (5)  establishes  a requirement  that  each 
solicitation  provide  for  industry  feedback  from  prospective  contractors 
prioi  to  the  proposal  due  date.  Also,  the  services  have  implemented 
a prerelease  of  the  RFP  requirements  for  industry  review  and  input. 

We  recommend  the  above  methods  in  lieu  of  the  ombudsman  group  as 
a means  of  making  industry  input  available  to  the  services  for  their 
use  in  arriving  at  a final  decision.  At  the  same  time  it  does  not 
have  the  drawback  of  potential  conflict  of  interest  that  a joint  group 
would  have. 

IV.  FAILURE: 


A.  Definition 

The  key  to  verification  of  an  operational  MTBF  is  the  definition 
of  failure  used  to  compute  the  MTBF.  This  definition  must  include 
what  is  counted  as  a failure  and  what  Is  excluded  as  a failure.  A 
failure  is  defined  as  "any  departure  from  the  required  performance  in 
excess  of  the  allowable  tolerances,  defined  in  the  equipment  configura- 
tion item  design  and  test  specification  due  to  its  own  internal  failure." 
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1.  Exclusions 

The  contractor  should  not  be  obligated  to  correct,  replace,  or  pro- 
pose ECP  actions  at  no  cost  to  the  government  with  respect  to  any  hard- 
ware item  under  RIW  nonconf ormance , loss  or  damage  by  reason  of: 

(a)  Fire 

(b)  Explo  sion 

(c)  Submersion 

(d)  Flood 

(e)  Aircraft  (vehicle)  crash 

(f)  Enemy  action 

(g)  Seal  broken  on  unit  while  outside  contractor's  control 

(h)  External  physical  damage  caused  by  accidental  or  wilful  mis- 
treatment 

(i)  Internal  physical  damage  caused  by  accompanying  external 
physical  damage  due  to  mistreatment  or  to  tampering  by  non- 
contractor personnel 

(j)  Act  of  God 

00  Induced  failures.  Failures  of  hardware  items  induced  by  mal- 
function or  improper  operation  of  outside  (system  interfacing) 

units 

(l)  Consequential/incidental  damages 

(m)  Unverified  failures  (i.e.,  the  item  "retest  okay") 

(n)  Improper  instal lation/operat ion/or  maintenance 

(o)  Having  been  designed  or  developed  or  produced  by  others  than 
the  warrantor. 

Repair/replacer.ent  actions  taken  by  the  contractor  with  respect  to 
hardware  items  damages  by  and/or  subjected  to  these  above-excluded  cir- 
cumstances/clauses/conditions should  be  compensated  b>  an  equitable 
adjustment  in  applicable  contract  provisions  including  but  not  limited 

to  price. 

ECPs  prepared  to  affect  design  changes  aimed  at  precluding  future 
failures  related  to  these  excluded  causes/circumstanccs/conditions 
and/or  which  have  the  effect  of  changing  the  design  and/or  environmental 
specifications  under  which  the  hardware  item  was  initially  procured, 
should,  for  the  purposes  of  RIW,  be  considered  as  relating  to  exclusions 
and  thus  be  subject  to  negotiation  and  equitable  contract  adjustment. 

In  RIW  program  management  practice,  there  would  be  a presumption 
that  all  candidate  hardware  items  returned  during  the  RIW  period  would 
be  covered  under  the  warranty,  and  the  contractor  would  bo  expected  to 
proceed  to  take  those  expedited  actions  most  advantageous  to  the  govern- 
ment's operational  status.  However,  if  such  actions  were  taken  in  good 
faith  on  hardware  items  ultimately  determined,  through  contractor  failure 
mode  analyses,  to  be  subject  to  any  of  the  excluded  conditions/causes/ 
circumstances  cited  above,  there  should  be  no  presumtpion  of  his  non- 
entitlemont  to  the  equitable  adjustment  provisions  of  the  contract. 
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However,  the  contractor  must  present  evidence  to  substantiate 
an  exclusion  and  the  government  must  have  a designated  individual 
with  the  authority  to  approve  or  disapprove  the  exclusion.  The  con- 
tractor should  have  the  right  to  place  contractor  personnel  at  any 
location  at  Government  expense  where  there  is  evidence  that  O&M  re- 
porting is  erroneous  (66-1  system)  or  that  conditions  (set  forth  in 
Section  IV. A)  under  which  the  contractor  is  not  responsible  may  have 
existed  but  were  not  reported. 

Those  units  returned  to  the  contractor,  which  fall  under  exclusions, 
should  be  referred  immediately  to  the  ACO  and  PCO  for  resolution.  Only 
those  failures  occurring  subsequent  to  final  acceptance  should  be  in- 
cluded in  the  RIW  Program.  Only  through  such  rigorous  control  can 
the  manufacturer  assure  that  proper  maintenance  is  being  conducted  on 
his  warranted  iteni(s).  The  repair  cost  of  excluded  failures  should 
be  covered  by  a separate  clause  or  contract. 

All  failed  units  returned  to  the  contractor  should  be  accompanied 
by  a statement  of  failure  mode,  operational  and  test  data,  etc.,  com- 
pleted accurately  and  comprehensively  utilizing  contractor  recommended 
testing  facilities,  equipment  and  procedures. 

The  verification  of  failure  should  be  performed  by  a method  agreed 
to  by  both  the  government  and  the  contractor.  The  use  of  built-in- 
test  (BIT),  based  on  pant  P.IT  capability,  would  rule  this  out  as  an 
acceptable  method  to  both  parties.  The  use  of  detailed  acceptance 
test  procedures  and  an  intermediate  or  depot  manufacturing  tester  would 
probably  be  the  minimum  test  method  for  failure  verification  acceptable 
to  both  parties. 

2 . Degree  of  Control,  Government  vs.  Contractor 

Interface  and  authority/responsibility  patterns  between  organic 
maintenance  functions  and  warrantor  must  be  clearly  defined.  The  govern- 
ment must  be  prepared  in  this  area  to  make  hard  decisions  concerning 
a possible  revamping  of  traditional  organic  maintenance  and  support 
functions  now  held  closely  by  the  services,  in  favor  of  an  augumsntcd 
role  in  these  areas  of  the  design  authority  - viz.,  the  contractor.  This 
is  true  because  the  contractor  perceives  his  risk  to  be  greater  or  less 
in  direct  proportion  to  the  degree  and  extent  of  his  involvement  in 
field  operations  and  logistics  management  activities.  Also,  because 
the  field  rel iability/dcs Lgu  loop  is  best  closed  by  the  mechanism  of 
coherent  contractor  management  of  field  service/dcsign  organization 
activities. 

The  warrantor  should  have  complete  visibility  and  requisite  control 
over  assets  management  (handling  of  hardware,  recording  and  validation 
of  failure  data,  fault  mode  analysis,  pipeline  spares  management,  access 


to  government  records,  etc.)  during  the  field-test-before-warranty 
phase  as  well  as  during  the  long-term  RIW  phase  production/spares  con- 
tracts . 

3.  Timing,  Responsibility  Vesting 

Turn-around  time  (TAT)  for  each  warranted  item  should  be  agreed 
to  by  the  government  and  industry  preferably  as  a range  or  band  of 
time  (e.g.,  21-30  days).  The  TAT  "clock"  (i.e.,  start  of  contractor 
responsibility)  should  start  upon  date  of  receipt  of  the  warrantable 
asset(s)  as  verified  by  the  ACO's  representative,  at  the  contractor's 
repair  facility,  also  to  be  contractually  designated. 

Responsibility  for  control  of  the  asset  (s)  should  be  considered 
to  be  transferred  back  to  the  government  effective  with  turnover  to 
the  resident  government  inspection  and  acceptance  authority  at  the  con- 
tractor's repair  facility.  Shipments  should  be  made  F.O.B.  contractor's 
plant  on  a Government  bill  of  Lading. 

TAT  performance  should  be  assessed  and  measured  over  the  whole 
warranty  population  and  period  - not  on  an  individual  return  basis. 
Evaluation  of  TAT  performance  should  be  made  on  the  basis  of  the  average 
of  all  item  returns  to  determine  that  such  average  TAT  fell  within 
the  contractually  established  time  band.  Penalties  for  exceeding  the 
upper  limit  of  the  TAT  band  should  be  assessed  only  if  it  can  be  con- 
clusively established  that  the  delay  was  caused  by  or  attributable  to 
gross  failure,  negligence  or  to  the  chronic  lack  of  managerial  diligence 
on  the  part  of  the  contractor's  managers.  Assessment  of  liquidated 
damages  in  connection  with  TAT  is  unjustifiable  in  any  case  since  this 
would  result  in  double  jeopardy  in  conjunction  with  requirements  for 
consignment  spares. 

A.  Retest  O.K. 

Excessive  retest  okay  equipments  are  a problem  to  both  the 
government  (increased  pipeline,  low  availability)  and  the  contractor 
(cost  of  testing).  Therefore,  the  government  should  be  required  to 
pay  the  contractor  for  each  returned  equipment  that  retests  okay.  The 
value  should  be  large  enough  to  compensate  the  contractor  for  the 
cost  of  testing  and  to  encourage/force  the  government  to  perform  adequate 
testing  at  the  base  level  to  reduce  the  number  of  retest  okay  returns. 


LIST  OF  REFERENCES 


1.  Allen,  D.J.,  Application  of  Reliability  Improvement 
Warranty  ( RTW)  to  POD  Procurements,  Thesis,  Naval 
Postgraduate  School , Monterey,  Ca.,  March  1975. 

2.  Air  Force  Flight  Dynamics  Laboratory,  Report  AFFDL-TR- 
71-22,  Analysis  of  Aeronautical  Equipment  Environmental 
Failures , by  A.  Dentowitz,  G.  Hirschberger  and  D. 

Pravidlo , May  1971. 

3.  ARING  Research  Corporation,  Publication  1264-01-1-1370, 

The  Development  and  Analysis  of  RIW  and  COD  Provisions 
for  the  AirCombat.  Fighter  (ACF)  Aircraft,  by  G. 

Harrisoig  February , 1975 . 

4.  ARING  Research  Corporation,  Publication  1500-01-1-1451, 
Guidelines  for  Application  of  Warranties  to  Air  Force 
Electronic  Systems,  by  H.  S.  Balaban  and  B.  L.  Rotterer , 
December  197  5 . 

5.  Army  Material  Command,  Report  APROA507,  Analysis  of 
AMC's  Use  of  Warranties,  by  C.  E.  Beckler  and  II.  F. 

Candy , June  1975. 

6.  Assistant  Secretary  of  Defense  (I&L)  and  Director, 

Defense  Research  and  Engineering,  Memorandum  to 
Assistant  Secretaries  of  the  Military  Department, 

Sub j ect : Trial  Use  of  Reliability  Improvement  Warranties 
in  the  Acquisition  Process  for  Electronic  Systems/ 
Equipments-Act ion  Memorandum,  14  August  1974. 

7.  Assistant  Secretary  of  Defense  (I&L),  Memorandum  to 
Assistant  Secretaries  of  the  Military  Departments, 

Subject:  Reliability  Improvement  Warranty  (RIW)  Guidelines, 
16  Sept  1975. 

8.  Balaban,  H.S.  and  Nohmer,  F.J.,  "Warranty  Procurement  - 
A Case  History,"  Proceedings  1975  Annual  Reliability 
and  Maintainability  Symposium , pp . 543-548 , Washington , 
D.C.,  January  197S. 

9.  Bardswell , W.L.  and  Brentnall,  G.J.,  A Study  of  the 
Effects  of  the  Effects  of  Warranties  on  the  Reliability 
of  Two  Airborne  Electronics  Subsystems,  Thesis,  Air 
Force  Institute  of  Technology,  Wright- Patter son  Air 
Force  Base,  Ohio,  1973. 


1 I 


1 


10.  Commander,  Naval  Air  Systems  Command,  Draft  Instruction, 
Subject:  Reliability  Improvement  Warranty  Provisions; 
Interim  Guidelines  for,  30'  July  1*?76 . 

11.  Council  of  Defense  and  Space  Industry  Associations 
(CODSIA)  Letter  to  U.S.  Army  Procurement  Research 
Office,  Subject:  Army  Research  Office  Projection  Warran- 
ties , 2 July  1975. 

12.  Council  of  Defense  and  Space  Industry  Associations 
(CODSIA)  Letter  to  Chairman  Tri-Service  Group  on 
Reliability  and  Support  Incentives,  Subject:  Reliability 
Improvement  Warranties,  30  December  1975. 

13.  Council  of  Defense  and  Space  Industry  Associations 
(CODSIA)  Letter  to  Director  of  Procurement  Policy  United 
States  Air  Force,  Subject:  Reliability  Improvement 
Warranties  - Key  Issues , 2 3 April  1976. 

14.  Dunn,  P.E.,  Jr.  and  Olytan,  A.W. , Evaluation  of  Proposed 
Criteria  to  be  Used  in  the  Selection  of  Candidates  for 
Reliability  Improvement  Warranties,  Thesis , Air  Force 
Institute  of  Technology,  Wright  Patterson  Air  Force 
Base,  Ohio,  January  1975. 

15.  Higgins,  Joseph  L. , Long  Term  Service  Warranty  Contracts  - 
A Case  Example  of  Gyroscopes  Purchased  Under  Warranty , 
Thesis , Air  Force  Institute  of  Technology , Wright- 
Patterson  Air  Force  Base,  Ohio,  September  1972. 

16.  Klass,  P.J.,  "USAF , Army  Studying  Contract  Changes," 
Aviation  Week  and  Space  Technology,  8 December  1975. 

17.  Knight,  C.R.,  "Warranties  as  a Life  Cycle  Cost 
Management  Tool",  Defense  Management  Journal,  pp.  23- 
28,  January  1976. 

18.  Koegel,  T.R.  and  Mills,  N.B.  Jr.,  An  Analysis  of  Decision 
Criteria  for  the  Selection  of  F-16  Reliability  Improvement 
Incentive  Alternatives,  Thesis’^  Air  Force  Institute  of 
Technology,  Wright-Patterson  Air  Force  Base,  Ohio, 
September  1975. 

19.  Markowitz,  O. , "A  New  Approach  Long  Range  Fixed  Price 
Warranty  Within  Operational  Fnvironments  for  Buyer/ 

User" , Annals  of  Reliability  and  Maintainability  - 1971, 
v.  10,  Anaheim,  Ca. , June  1971. 

20.  Marsh,  R.T.,  "Avionics  Equipment  Reliability:  An  Elusive 
Object",  Defense  Management  Journal,  pp.  24-29,  April 
1976. 


I 1 r> 


L 


21.  Martin,  J.  and  Schotta,  E.A.,  Reliability  Improvement 
Warranties  - RIW,  presentation  to  Chief  Naval  Material, 
Washington  D.C.,  5 December  1975. 

22.  Martin,  J.  and  Schotta,  E.A. , Personal  Interview,  Naval 
Air  Station,  Patuxent  River,  Maryland,  21-22  October 
1976. 

23.  Meth,  M . A . , "A  DOD  Approach  to  Establishing  Weapon 
System  Reliability  Requirements",  Defense  Management 
Journal , pp.  2-11,  April  1976. 

24.  Naval  Aviation  Integrated  Logistic  Support  Center, 

Internal  Report  ILS  210-3-75,  A Report  on  the  Logistic 
Support  Cost  Control  Processes~for  the  F-16  Aircraft, 
by  J . A.  Martin , E . A.  Schotta , Naval  Air  Station, 

Patuxent  River,  Maryland,  March  1975. 

25.  Naval  Aviation  Supply  Office,  Proceedings  of  Failure 
Free  Warranty  Seminar,  Philadelphia , Pennsylvania , 

December  1973. 

26.  Naval  Weapons  Engineering  Support  Activity,  Report 

R- 7 5 0 5 , Techniques  for  Selecting  and  Analyzing  Reliability 
Improvement  Warranties,  by  J.A.  Bizup  and  R.R.  Moore, 

June  1975. 

27.  Office  of  the  Director  of  Defense  Research  and  Engineering, 
Report  R-195,  Electronics-X : A Study  of  Military 
Electronics  with  Particular "Reference  to  Cost  and 
Reliability-)  by  H . P . Gates  et.  al . , v.  1 and  v.  2, 

January  1974. 

28.  Office  of  the  Assistant  Secretary  of  Defense  (I&L), 
Memoranda  for  Record,  Subject:  Meetings  1-6  Tri-Service 
Reliability  Support  Incentives  Group,  Washington,  D.C., 
October  1975-June  1976. 

29.  Rome  Air  Development  Center,  Report  RADC-TR-69-363 , 

Airborne  Electronic  Equipment  Lifetime  Guarantee,  by 
C.M.  Dewitt , et~  a 1.,  November  1969. 

30.  Rome  Air  Development  Center,  Report  RADC-TR-75,  Evaluation 
of  Environmental  Profiles  for  Reliability  Demonstration-) 
September  1975. 

31.  Shorey,  R.R.,  "Managing  Downstream  Weapons  Acquisition 
Cost",  Defense  Management  Journal,  pp.  10-17,  January 
1976. 


J 


32.  Stansberry,  J.K.,  'Source  Selection  and  Contracting 
Approach  to  Life  Cycle  Cost  Management" , Def ense 
Management  Journal,  pp.  18-22,  January  197f. 

33.  Trimble,  R.F. , "Can  Contract  Methodology  Improve 
Product  Reliability",  Defense  Management  Journal, 
pp.  20-23,  April  1976. 

34.  Willoughby,  W.J.,  "Reliability  by  Design  Not  by 
Chance",  Defense  Management  Journal',  pp.  2-11, 
April  1976. 


INITIAL  DISTRIBUTION  LIST 

No.  Copies 

1.  Defense  Documentation  Center  2 

Cameron  Station 

Alexandria,  Virginia  22314 

2.  Library,  Code  0212  2 

Naval  Postgraduate  School 

Monterey,  California  93940 

3.  Department  Chairman,  Code  54  2 

Department  of  Administrative  Sciences 

Naval  Postgraduate  School 
Monterey,  California  93940 

4.  Adjunct  Professor  R.R.  Judson,  Code  54Ju  4 

Department  of  Administrative  Sciences 

Naval  Postgraduate  School 
Monterey,  California  93940 

5.  Professor  J.D.  Esary,  Code  55Ey  1 

Department  of  Operations  Research 

Naval  Postgraduate  School 
Monterey,  California  93940 

6.  Mr.  John  Martin,  ILS  Code  210  2 

Naval  Air  Logistic  Support  Center 

Naval  Air  Station 

Patuxent  River,  Maryland  20670 

7.  Mr.  Martin  Meth  1 

Office  of  the  Secretary  of  Defense  (I&L) 

Washington,  D.C.  20301 

8.  CDR.  R.F.  Habicht,  USN  1 

38  Half  Moon  Bend 

Coronado,  California  92118 


1 18 


